-- Logs begin at Wed 2021-07-28 02:58:32 UTC, end at Wed 2021-07-28 04:24:23 UTC. -- Jul 28 03:28:56.148358 dv-cinder-733062-21-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 03:28:56.157012 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 03:28:56.158978 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 28 03:28:56 2021] *** Jul 28 03:28:56.158978 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 03:28:56.158978 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 03:28:56.158978 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: nodename: dv-cinder-733062-21-iscsi Jul 28 03:28:56.158978 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: machine: x86_64 Jul 28 03:28:56.158978 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: clock source: unix Jul 28 03:28:56.158978 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: pcre jit disabled Jul 28 03:28:56.158978 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: detected number of CPU cores: 4 Jul 28 03:28:56.158978 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: current working directory: / Jul 28 03:28:56.158978 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: detected binary path: /usr/bin/uwsgi-core Jul 28 03:28:56.159750 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: your processes number limit is 47680 Jul 28 03:28:56.159750 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: your memory page size is 4096 bytes Jul 28 03:28:56.159750 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: detected max file descriptor number: 2048 Jul 28 03:28:56.159750 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: lock engine: pthread robust mutexes Jul 28 03:28:56.159750 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: thunder lock: enabled Jul 28 03:28:56.159750 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 03:28:56.159750 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 28 03:28:56.204440 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: Python main interpreter initialized at 0x55a750b229c0 Jul 28 03:28:56.204440 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: python threads support enabled Jul 28 03:28:56.204440 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: your server socket listen backlog is limited to 100 connections Jul 28 03:28:56.204440 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: your mercy for graceful operations on workers is 90 seconds Jul 28 03:28:56.204837 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 03:28:56.204914 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: *** Operational MODE: preforking *** Jul 28 03:28:56.205231 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: *** uWSGI is running in multiple interpreter mode *** Jul 28 03:28:56.205231 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: spawned uWSGI master process (pid: 92535) Jul 28 03:28:56.205426 dv-cinder-733062-21-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 03:28:56.211747 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: spawned uWSGI worker 1 (pid: 92536, cores: 1) Jul 28 03:28:56.211747 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: spawned uWSGI worker 2 (pid: 92537, cores: 1) Jul 28 03:28:56.211747 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 03:28:57.847125 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:28:57.847125 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: from cryptography.utils import int_from_bytes Jul 28 03:28:57.847802 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:28:57.847802 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: from cryptography.utils import int_from_bytes Jul 28 03:28:57.848237 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:28:57.848237 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: from cryptography.utils import int_from_bytes Jul 28 03:28:57.848349 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:28:57.848349 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: from cryptography.utils import int_from_bytes Jul 28 03:29:00.563030 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:29:00.563549 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:29:00.563640 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:29:00.564032 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:29:00.564253 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:29:00.564642 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:29:00.564739 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:29:00.564820 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.565102 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.565186 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:29:00.565426 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.565512 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:29:00.565722 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:29:00.565803 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.566061 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.566161 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.566379 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.566460 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.566702 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.566792 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.567021 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.567111 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.567348 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.567432 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.567608 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.567698 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.567950 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.568041 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.568273 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-21-iscsi {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.568356 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.568610 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.568691 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.568891 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.568975 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.569198 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.569282 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.569517 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.569648 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-21-iscsi {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.569820 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.569944 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.570140 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.570304 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.570433 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.570564 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.570759 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.570928 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.571082 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.571372 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.571480 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.571676 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.571788 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.572014 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.572217 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.572355 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.572533 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.572655 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.572825 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.572943 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.573157 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.573277 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.573473 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.573629 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.573791 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.573910 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.574099 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.574274 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.574488 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.574677 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-21-iscsi {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.574868 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.575022 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.575243 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.575430 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.575582 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.575812 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.575996 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-21-iscsi {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.576193 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.576341 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.576591 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.576775 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.576945 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.577134 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.577272 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.577418 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.577548 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.577669 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.577825 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.577962 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.578090 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.578215 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.578344 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.578494 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.578628 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.578777 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.578904 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.578904 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.579205 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.579370 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.579546 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.580315 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.580444 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.580583 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.580705 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.580705 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.581027 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.581158 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.581340 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.581479 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.581601 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.581725 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.581890 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.582017 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.582218 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.582385 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.582549 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.582714 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.582880 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.583110 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.583110 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.583510 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.583632 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.583772 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.583892 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.584012 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.584146 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.584265 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.584265 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.584499 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.584619 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.584746 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.584865 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.585025 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.585195 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.585368 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.585535 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.585713 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.585886 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.586034 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.586153 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.586278 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.586278 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.586517 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.586637 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.586754 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.586872 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.586989 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.587179 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.587315 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.587500 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.587668 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.587896 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.588063 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.588236 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.588413 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.588592 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.588717 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.588837 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.588955 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.589081 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.589201 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.589376 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.589500 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.589948 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.590082 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.590267 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.590398 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.590587 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.590712 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.590894 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.591015 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.591198 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.591320 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.591506 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.591629 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.591847 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.591983 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.592158 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.592281 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.592461 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.592585 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.592703 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.592833 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.593000 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.593122 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.593307 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.593437 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.593621 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.593756 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.593925 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.594048 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.594231 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.594352 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.594535 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.594669 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.595071 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.595204 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.595329 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.596128 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.596128 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.596471 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.596636 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.597088 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.597259 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.597392 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.597529 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.597687 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.597821 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.597994 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.598119 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.598301 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.598434 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.598610 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.598763 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.598914 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.599090 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.599218 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.599413 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.599536 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.599772 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.599911 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.600109 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.600239 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.600429 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.600551 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.600745 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.600865 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.601049 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.601184 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.601361 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.601489 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.601665 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.601792 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.601972 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.602093 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.602294 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.602415 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.602599 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.602751 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.602906 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.603035 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.603216 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.603337 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.603520 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.603641 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.603856 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.603978 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.604172 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.604295 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.604471 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.604592 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.604779 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.604908 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.605088 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.605210 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.605395 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.605515 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.605702 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.605832 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.606008 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.606137 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.606311 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.606439 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.606613 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.606742 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.606917 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.607044 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.607213 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.607339 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.607518 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.607650 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.607840 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.607963 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.608141 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.608262 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.608463 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.608604 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.608771 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.608894 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.609078 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.609202 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.609383 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.609508 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.609687 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.609819 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.610007 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:29:00.610131 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.610343 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.610468 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.610682 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.610811 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.611089 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.611281 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.611607 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.611799 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.611799 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.612035 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.612154 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.612287 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.612409 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.612528 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.612647 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.612767 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.612939 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.613073 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.613255 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.613387 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.613573 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.613704 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.613888 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.614022 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.614212 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.614343 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.614535 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.614652 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.614869 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.615004 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.615188 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.615322 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.615506 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.615629 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.615847 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.615986 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.616165 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.616332 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.616476 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.616599 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.616797 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.616930 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.617122 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.617244 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.617437 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.617568 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.617747 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.617886 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.618092 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.618217 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.618415 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.618545 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.618735 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.618868 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.619046 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.619168 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.619362 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.619492 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.619684 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.619865 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.620020 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.620156 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.620334 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.620455 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.620646 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.620767 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.620959 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.621080 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.621269 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.621389 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.621584 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.621716 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.621912 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.622033 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.622233 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.622364 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.622542 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.622664 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.622848 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.622988 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.623152 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.623282 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.623456 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.623577 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.623784 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.623908 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.624101 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.624235 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.624423 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.624546 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.624729 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.624849 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.625048 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.625178 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.625359 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.625481 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.625673 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.625802 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.625985 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.626118 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.626289 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.626411 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.626602 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.626753 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.626953 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.627153 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.627314 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.627443 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.627570 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.627689 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.627860 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.627989 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.628154 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.628276 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.628476 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.628598 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.628782 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.628904 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.629089 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.629219 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.629426 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.629562 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.629722 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.629847 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.630032 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.630155 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.630345 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.630468 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.630661 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.630785 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.630972 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.631100 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.631282 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.631417 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.631595 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.631738 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.631966 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.632101 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.632275 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.632407 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.632592 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.632722 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.632917 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.633041 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.633231 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.633365 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.633538 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.633662 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.633841 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.633964 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.634148 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.634347 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.634468 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.634593 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.634743 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.634867 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.635050 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.635175 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.635356 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.635478 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.635659 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.635839 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.635975 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.636096 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.636280 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.636404 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.636585 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.636707 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.636887 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.637015 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.637208 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.637336 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.637513 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.637636 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.637818 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.637943 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.638123 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.638247 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.638428 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.638553 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.638764 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.638895 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.639071 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.639203 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.639405 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.639528 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.639734 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.639859 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.640065 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.640189 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.640379 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.640517 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.640689 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.640818 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.640996 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.641121 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.641306 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.641438 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.641619 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.641744 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.641928 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.642052 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.642760 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.642926 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.643110 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.643306 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.643481 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.643669 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.643824 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.644018 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.644145 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.644337 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.644460 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.644664 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.644830 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.644974 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.645097 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.645288 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.645417 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.645602 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.645734 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.645912 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.646041 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.646218 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.646341 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.646528 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.646664 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.646832 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.646954 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.647139 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.647265 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.647452 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.647582 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.647786 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.647913 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.648094 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.648215 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.648404 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.648539 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.648711 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.648834 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.649019 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.649141 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.649325 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.649449 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.649633 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.649755 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.649939 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.650070 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.650251 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.650375 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.650572 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.650693 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.650883 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.651004 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.651192 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.651315 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.651502 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.651626 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.651834 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.651957 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.652142 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.652267 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.652450 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.652572 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.652760 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.652884 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.653066 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.653189 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.653379 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.653511 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.653691 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.653823 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.654007 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.654128 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.654327 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.654457 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.654629 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.654760 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.654948 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.655064 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.655263 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.655385 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.655571 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.655732 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.655908 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.656041 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.656218 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.656340 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.656529 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.656661 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.656840 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.656968 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.657152 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.657274 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.657461 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.657585 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.657771 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.657947 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.658649 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.658849 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.659024 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.659149 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.659270 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.659390 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.659546 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.659670 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.659884 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.660011 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.660194 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.660325 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.660505 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.660629 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.660827 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.660953 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.661140 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.661397 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.661529 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.661735 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.662018 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.662142 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.662360 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.662492 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.662681 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.662817 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.663004 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.663135 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.663330 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.663454 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.663654 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.663840 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.663999 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.664140 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.664310 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.664434 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.664627 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.664829 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.664959 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.665079 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.665233 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.665358 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.665543 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.665667 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.665848 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.665964 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.666155 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.666278 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.666462 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.666585 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.666770 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.666894 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.667074 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.667209 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.667382 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.667512 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.667685 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.667834 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.668012 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.668136 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.668319 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.668444 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.668623 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.668746 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.668937 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.669059 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.669240 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.669365 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.669550 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.669665 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.669856 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.669987 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.670165 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.670288 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.670470 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.670599 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.670775 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.670911 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.671079 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.671203 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.671384 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.671509 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.671756 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.671898 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.672059 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.672189 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.672396 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.672521 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.672707 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.672838 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.673016 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.673140 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.673343 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.673493 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.673679 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.673859 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.674056 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.674248 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.674443 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.674570 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.674753 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.674877 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.675061 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.675184 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.675365 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.675487 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.675674 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.675818 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.676006 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.676131 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.676319 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.676451 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.676629 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.676765 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.676934 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.677066 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.677241 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.677363 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.677545 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.677668 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.677853 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.677977 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.678158 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.678281 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.678461 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.678583 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.678768 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.678892 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.679068 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.679197 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.679371 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.679494 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.679680 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.679832 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.680009 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.680132 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.680313 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.680435 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.680621 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.680745 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.680924 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.681048 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.681229 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.681351 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.681530 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.681653 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.681840 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.681964 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.682144 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.682277 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.682450 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.682579 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.682755 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.682878 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.683058 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.683193 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.683373 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.683495 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.683687 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.683828 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.684014 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.684152 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.684319 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.684442 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.684620 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.684749 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.684925 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.685059 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.685235 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.685359 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.685544 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.685673 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.685857 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.685989 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.686158 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.686288 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.686465 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.686587 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.686766 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.686888 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.687072 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.687196 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.687377 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.687499 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.687682 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.687821 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.688012 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.688134 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.688316 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.688449 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.688648 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.688770 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.688912 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.689034 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.689732 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.689916 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.690116 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.690315 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.690451 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.690573 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.690694 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.690813 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.690942 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.691153 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.691286 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.691464 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.691601 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.691853 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.691993 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.692168 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.692301 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.692492 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.692623 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.692812 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.692936 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.693130 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.693260 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.693441 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.693564 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.693753 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.693879 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.694058 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.694188 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.694360 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.694490 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.694675 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.694800 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.694987 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.695118 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.695294 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.695416 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.695597 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.695761 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.696140 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.696266 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.696393 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.696524 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.696653 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.696781 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.696902 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.697022 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.697147 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.697280 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.697440 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.697565 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.697764 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.698176 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.698302 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.698432 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.698553 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.698674 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.698793 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.698919 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.699040 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.699168 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.699289 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.699409 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.699535 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.699665 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.699852 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.699974 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.700165 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.700295 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.700476 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.700600 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.700787 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.700913 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.701095 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.701218 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.701399 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.701522 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.701710 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.701842 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.702018 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.702149 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.702319 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.702442 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.702643 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.702766 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.702949 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.703071 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.703253 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.703385 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.703559 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.703745 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.703871 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.703990 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.704181 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.704318 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.704485 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.704609 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.705478 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.705696 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.705909 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.706079 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.706186 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.706326 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.706417 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.706650 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.706734 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.706972 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.707057 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.707289 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.707413 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.707607 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.707770 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.707937 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.708055 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.708361 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.708486 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.708681 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.708817 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.708994 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.709119 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.709310 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.709439 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.709616 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.709747 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.709924 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.710058 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.710238 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.710360 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.710563 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.710694 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.710872 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.710996 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.711178 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.711303 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.711486 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.711617 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.711833 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.711957 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.712144 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.712271 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.712470 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.712603 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.712888 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.713011 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.713203 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.713334 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.713508 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.713632 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.713926 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.714049 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.714237 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.714367 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.714552 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.714927 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.715126 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.715248 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.715452 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.715575 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.715798 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.715926 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.716107 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.716230 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.716424 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.716548 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.716734 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.716865 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.717060 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.717189 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.717385 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.717516 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.717696 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.717819 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.718012 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.718129 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.718320 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.718451 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.718641 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.718764 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.718966 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.719091 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.719283 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.719488 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.719613 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.719754 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.720037 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.720161 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.720387 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.720572 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.720772 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.720969 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.721099 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.721220 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.721349 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.721471 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.721615 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.721741 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.721928 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.722052 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.722240 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.722373 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.722569 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.722696 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.722877 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.723007 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.723201 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.723324 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.723507 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.723630 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.723841 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.723969 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.724155 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.724286 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.724463 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.724585 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.724768 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.724892 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.725073 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.725196 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.725393 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.725519 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.725698 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.725831 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.726033 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.726155 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.726322 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.726446 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.726642 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.726774 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.726961 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.727085 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.727266 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.727388 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.727586 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.727736 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.727918 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.728043 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.728224 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.728347 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.728532 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.728686 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.728821 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.728953 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.729164 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.729290 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.729497 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.729625 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.729792 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.729989 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.730114 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.730234 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.730437 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.730561 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.730746 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.730883 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.731082 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.731206 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.731403 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.731527 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.731733 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.731870 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.732057 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.732187 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.732381 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.732505 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.732686 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.732810 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.732990 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.733112 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.733299 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.733421 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.733602 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.733726 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.733908 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.734031 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.734212 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.734343 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.734522 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.734647 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.734825 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.734948 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.735127 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.735258 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.735432 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.735556 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.735779 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.735908 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.736125 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.736338 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.736541 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.736716 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.736850 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.736975 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.737087 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.737214 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.737342 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.737464 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.737616 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.737747 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.737960 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.738098 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.738267 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.738398 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.738600 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.738725 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.738918 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.739049 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.739238 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.739363 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.739567 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.739692 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.739902 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.740028 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.740226 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.740359 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.740546 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.740670 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.740865 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.740989 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.741179 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.741302 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.741495 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.741619 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.741811 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.741942 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.742124 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.742254 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.742437 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.742560 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.742746 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.742869 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.743061 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.743183 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.743375 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.743508 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.743692 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.743832 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.744236 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.744361 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.744568 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.744700 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.744883 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.745007 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.745197 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.745327 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.745507 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.745639 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.745829 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.745960 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.746141 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.746265 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.746454 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.746578 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.746761 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.746892 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.747072 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.747202 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.747379 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.747503 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.747739 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.747867 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.748052 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.748176 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.748385 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.748509 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.748723 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.748854 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.749043 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.749176 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.749361 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.749485 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.749678 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.749800 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.750001 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.750134 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.750364 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.750486 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.750687 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.750810 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.751000 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.751125 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.751318 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.751442 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.752179 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.752372 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.752585 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.752785 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.752942 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.753073 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.753196 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.753316 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.753445 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.753567 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.753743 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.753869 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.754064 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.754197 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.754378 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.754505 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.754697 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.754820 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.755014 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.755148 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.755344 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.755468 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.755682 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.755871 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.756005 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.756140 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.756326 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.756452 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.756640 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.756763 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.756958 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.757091 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.757482 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.757608 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.757799 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.757922 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.758135 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.758260 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.758462 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.758594 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.758786 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.758909 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.759103 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.759227 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.759421 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.759552 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.759772 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.759900 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.760104 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.760228 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.760379 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.760511 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.760692 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.760809 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.761003 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.761130 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.761310 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.761435 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.761633 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.761767 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.761949 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.762074 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.762262 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.762393 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.762583 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.762717 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.762893 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.763066 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.763428 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.763683 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.763853 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.764101 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.764227 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.764427 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.764551 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.764756 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.764888 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.765076 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.765201 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.765384 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.765537 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.765709 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.765890 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.766016 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.766261 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.766386 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.766610 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.766734 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.766921 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.767046 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.767826 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.768026 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.768226 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.768416 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.768559 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.768682 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.768858 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.768984 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.769204 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.769329 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.769556 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.769681 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.769903 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.770029 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.770255 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.770387 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.770603 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.770721 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.770948 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.771080 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.771295 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.771427 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.771642 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.771780 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.772012 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.772135 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.772361 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.772499 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.772708 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.772831 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.773052 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.773176 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.773397 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.773529 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.773740 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.773863 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.774091 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.774216 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.774436 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.774576 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.774789 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.774913 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.775139 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.775264 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.775488 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.775621 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.775854 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.775980 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.776206 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.776340 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.776553 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.776682 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.776897 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.777021 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.777249 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.777372 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.777597 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.777721 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.777955 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.778078 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.778306 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.778430 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.778657 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.778786 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.779012 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.779161 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.779366 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.779491 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.779779 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.780014 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.780139 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.780395 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.780755 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.780890 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.781137 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.781268 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.781501 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.781624 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.781845 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.781977 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.782196 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.782328 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.782540 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.782665 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.782946 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.783151 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.783351 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.783542 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.783673 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.783844 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.784047 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.784205 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.784394 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.784518 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.784753 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.784878 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.785126 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.785251 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.785488 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.785683 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.785868 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.786068 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.786422 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.786549 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.786788 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.786915 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.787161 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.787285 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.787526 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.787652 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.787926 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.788055 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.788286 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.788411 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.788645 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.788771 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.789016 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.789167 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.789376 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.789508 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.789754 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.789880 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.790117 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.790247 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.790439 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.790572 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.790772 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.790892 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.791089 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.791214 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.791398 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.791532 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.791825 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.791952 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.792143 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.792267 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.792475 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.792601 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.792800 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.792925 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.793113 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.793246 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.793442 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.793565 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.793765 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.793890 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.794094 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.794219 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.794418 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.794551 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.794725 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.794849 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.795031 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.795156 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.795336 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.795461 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.795647 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.795821 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.795996 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.796129 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.796311 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.796436 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.796656 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.796788 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.797136 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.797273 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.797395 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.797515 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.797634 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.797753 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.797872 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.798000 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.798174 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.798306 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.798550 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.798725 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.798913 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.799125 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.799300 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.799425 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.799545 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.799666 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.799826 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.799954 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.800115 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.800246 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.800442 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.800566 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.800758 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.800882 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.801086 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.801204 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.801402 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.801525 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.801729 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.801853 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.802040 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.802163 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.802352 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.802475 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.802664 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.802787 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.802983 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.803114 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.803302 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.803425 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.803616 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.803762 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.803961 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.804084 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.804272 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.804408 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.804595 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.804717 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.804912 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.805042 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.805227 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.805357 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.805539 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.805670 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.805860 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.805981 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.806173 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.806303 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.806487 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.806611 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.806800 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.806931 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.807148 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.807292 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.807415 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.807536 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.807747 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.807877 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.808050 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.808176 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.808368 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.808492 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.808673 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.808798 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.808997 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.809123 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.809315 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.809439 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.809634 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.809757 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.809948 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.810075 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.810263 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.810394 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.810581 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.810713 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.810893 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.811017 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.811210 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.811328 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.811522 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.811656 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.811866 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.811990 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.812181 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.812317 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.812493 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.812628 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.812812 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.812943 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.813175 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.813316 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.813451 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.813572 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.813768 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.813900 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.814672 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.814865 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.815080 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.815266 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.815266 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.815503 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.815631 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.815799 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.815937 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.816060 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:29:00.816271 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:29:00.816515 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:29:00.838743 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG oslo_db.sqlalchemy.engines [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:29:00.840012 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_db.sqlalchemy.engines [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:29:00.917723 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.context [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9a031e6-2f7b-43a5-9c59-929dc71d7c62(cell1) {{(pid=92536) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:29:00.917960 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.context [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9a031e6-2f7b-43a5-9c59-929dc71d7c62(cell1) {{(pid=92537) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:29:00.921901 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG oslo_concurrency.lockutils [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:29:00.922009 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:29:00.924226 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:29:00.924363 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG oslo_concurrency.lockutils [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:29:00.925050 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:29:00.925285 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG oslo_concurrency.lockutils [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:29:00.927017 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:29:00.927208 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG oslo_concurrency.lockutils [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:29:00.937514 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_db.sqlalchemy.engines [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:29:00.940351 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG oslo_db.sqlalchemy.engines [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:29:00.942765 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG oslo_db.sqlalchemy.engines [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:29:00.948498 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_db.sqlalchemy.engines [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:29:01.301786 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG oslo_db.sqlalchemy.engines [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:29:01.304706 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_db.sqlalchemy.engines [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:29:01.646903 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: WARNING keystonemiddleware.auth_token [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:29:01.650224 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: WARNING keystonemiddleware.auth_token [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:29:01.653365 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: WARNING keystonemiddleware.auth_token [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:29:01.656628 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: WARNING keystonemiddleware.auth_token [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:29:01.998438 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: WARNING keystonemiddleware.auth_token [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:29:02.003635 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: WARNING keystonemiddleware.auth_token [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:29:02.006398 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: WARNING keystonemiddleware.auth_token [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:29:02.008803 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a750b229c0 pid: 92536 (default app) Jul 28 03:29:02.010890 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:29:02.012012 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: WARNING keystonemiddleware.auth_token [None req-34106bae-fef3-4bb3-8d03-2ce99ee4c97a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:29:02.012130 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001775 Jul 28 03:29:02.012540 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 789 bytes} [Wed Jul 28 03:29:02 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:29:02.017095 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a750b229c0 pid: 92537 (default app) Jul 28 03:30:21.465692 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:21.466688 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Jul 28 03:30:21.467083 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:21.885247 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-a452ccb5-a8af-4cba-a5a5-a2b017fe6b52 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:21.915594 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-a452ccb5-a8af-4cba-a5a5-a2b017fe6b52 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.440876 Jul 28 03:30:21.916283 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Jul 28 03:30:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:30:24.131895 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:24.132893 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-6ec496b2-8806-456a-86ba-b9d4c04b2a48 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 28 03:30:24.133465 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:24.206070 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-1c62fb26-294d-42f5-a462-4af611e8a776 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:24.225463 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:30:24.225463 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: warnings.warn(msg) Jul 28 03:30:24.256041 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-1c62fb26-294d-42f5-a462-4af611e8a776 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115781 Jul 28 03:30:24.256722 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Jul 28 03:30:24 2021] POST /compute/v2.1/flavors => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:30:24.478063 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-90af03af-c99d-4bbc-8d9c-bd76f0d3c3ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:24.480327 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:30:24.480327 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: warnings.warn(msg) Jul 28 03:30:24.527018 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-90af03af-c99d-4bbc-8d9c-bd76f0d3c3ef admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.261733 Jul 28 03:30:24.527594 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Jul 28 03:30:24 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:30:26.777171 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-1c62fb26-294d-42f5-a462-4af611e8a776 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:26.778146 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-1c62fb26-294d-42f5-a462-4af611e8a776 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Jul 28 03:30:26.778563 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:26.882413 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-b400228d-0de9-42d1-92fc-624b94c07600 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "name": "ds512M"}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:26.899879 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:30:26.899879 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: warnings.warn(msg) Jul 28 03:30:26.917825 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-b400228d-0de9-42d1-92fc-624b94c07600 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132729 Jul 28 03:30:26.918369 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Jul 28 03:30:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:30:26.933244 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-ce0fbb7e-3240-4722-b06d-ed9117bf55c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:26.936294 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:30:26.936294 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: warnings.warn(msg) Jul 28 03:30:26.969092 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-ce0fbb7e-3240-4722-b06d-ed9117bf55c6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040616 Jul 28 03:30:26.969799 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Jul 28 03:30:26 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:30:29.183415 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-b400228d-0de9-42d1-92fc-624b94c07600 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:29.185237 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-b400228d-0de9-42d1-92fc-624b94c07600 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Jul 28 03:30:29.185802 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:29.246438 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-2c9409a9-8bb4-4462-a02e-8a521304dd35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "swap": 0}} {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:29.268059 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-2c9409a9-8bb4-4462-a02e-8a521304dd35 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074857 Jul 28 03:30:29.269073 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Jul 28 03:30:29 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:30:29.282883 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-ff0ac97b-9fd1-4460-8425-42ef0182e45a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:29.308310 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-ff0ac97b-9fd1-4460-8425-42ef0182e45a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029838 Jul 28 03:30:29.309030 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Jul 28 03:30:29 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:30:31.576974 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-2c9409a9-8bb4-4462-a02e-8a521304dd35 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:31.578554 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-2c9409a9-8bb4-4462-a02e-8a521304dd35 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002205 Jul 28 03:30:31.579322 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:31 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:31.666271 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-94423103-8bb8-4686-ba58-b0f8c09bf3b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "id": "d3"}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:31.692751 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-94423103-8bb8-4686-ba58-b0f8c09bf3b8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.106867 Jul 28 03:30:31.693702 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Jul 28 03:30:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:30:31.706803 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-9e7bb754-574e-4a04-8f41-982096200f43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:31.735172 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-9e7bb754-574e-4a04-8f41-982096200f43 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033310 Jul 28 03:30:31.736138 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Jul 28 03:30:31 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:30:34.032628 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-94423103-8bb8-4686-ba58-b0f8c09bf3b8 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:34.034178 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-94423103-8bb8-4686-ba58-b0f8c09bf3b8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Jul 28 03:30:34.039922 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:34 2021] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:34.112314 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-cd4fde55-00bb-4fa6-8f64-6991cd8dd682 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:34.144902 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-cd4fde55-00bb-4fa6-8f64-6991cd8dd682 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.103462 Jul 28 03:30:34.145509 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Jul 28 03:30:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:30:34.158773 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-f2f1af09-5b2f-43eb-9203-9fde8a8c120f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:34.199522 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-f2f1af09-5b2f-43eb-9203-9fde8a8c120f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044336 Jul 28 03:30:34.215819 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Jul 28 03:30:34 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:30:36.461553 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-cd4fde55-00bb-4fa6-8f64-6991cd8dd682 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:36.463024 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-cd4fde55-00bb-4fa6-8f64-6991cd8dd682 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Jul 28 03:30:36.471946 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:36 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:36.532178 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-2f79cd2b-46ed-43bb-8951-de9522640451 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:36.558684 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-2f79cd2b-46ed-43bb-8951-de9522640451 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087547 Jul 28 03:30:36.560996 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Jul 28 03:30:36 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:30:38.854372 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-cd4fde55-00bb-4fa6-8f64-6991cd8dd682 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:38.855392 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-cd4fde55-00bb-4fa6-8f64-6991cd8dd682 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 28 03:30:38.855862 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:38.915167 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-39a8f4a3-d3e3-4782-9043-93b099181d20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:38.939445 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-39a8f4a3-d3e3-4782-9043-93b099181d20 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076147 Jul 28 03:30:38.940737 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Jul 28 03:30:38 2021] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:30:38.953742 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-95c4e1a2-96b5-4589-b16b-f1bbf6473018 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:38.978758 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-95c4e1a2-96b5-4589-b16b-f1bbf6473018 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029281 Jul 28 03:30:38.979319 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Jul 28 03:30:38 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:30:41.808517 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-39a8f4a3-d3e3-4782-9043-93b099181d20 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:41.809517 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-39a8f4a3-d3e3-4782-9043-93b099181d20 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 28 03:30:41.809915 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:41.866487 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-7212e7c1-35f3-40a7-a40b-897961a5c978 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "disk": 20, "id": "2"}} {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:41.887346 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-7212e7c1-35f3-40a7-a40b-897961a5c978 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069945 Jul 28 03:30:41.888103 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Jul 28 03:30:41 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:30:41.902453 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-705f31b6-b2ae-4b8f-bb9c-c77b78ed83c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:41.931961 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-705f31b6-b2ae-4b8f-bb9c-c77b78ed83c9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034429 Jul 28 03:30:41.932537 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Jul 28 03:30:41 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:30:44.351328 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-7212e7c1-35f3-40a7-a40b-897961a5c978 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:44.352457 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-7212e7c1-35f3-40a7-a40b-897961a5c978 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jul 28 03:30:44.353204 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:44.409319 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-cfab5549-8767-4040-b0aa-f925d902c9f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "disk": 40}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:44.428937 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-cfab5549-8767-4040-b0aa-f925d902c9f1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068964 Jul 28 03:30:44.429485 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Jul 28 03:30:44 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:30:44.441473 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-2bcc9ae6-5ffa-446f-97a6-5b603ee092be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:44.467059 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-2bcc9ae6-5ffa-446f-97a6-5b603ee092be admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029150 Jul 28 03:30:44.467684 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Jul 28 03:30:44 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:30:46.689907 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-cfab5549-8767-4040-b0aa-f925d902c9f1 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:46.691518 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-cfab5549-8767-4040-b0aa-f925d902c9f1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Jul 28 03:30:46.691965 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:46.755316 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-cc4f22da-58e1-4316-9412-9d39fcbc23c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 8192, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:46.773480 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-cc4f22da-58e1-4316-9412-9d39fcbc23c9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075078 Jul 28 03:30:46.774511 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Jul 28 03:30:46 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:30:46.786838 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-e8d5ed67-00e7-4760-9505-d89d9bc97c0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:46.811318 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-e8d5ed67-00e7-4760-9505-d89d9bc97c0b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028136 Jul 28 03:30:46.820010 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Jul 28 03:30:46 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:30:48.998195 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-cc4f22da-58e1-4316-9412-9d39fcbc23c9 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:30:48.999777 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-cc4f22da-58e1-4316-9412-9d39fcbc23c9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 28 03:30:49.000210 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:30:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:30:49.063630 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-d9938daf-d641-4468-bf58-31ee29d85bbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "id": "5"}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:49.083632 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-d9938daf-d641-4468-bf58-31ee29d85bbe admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076641 Jul 28 03:30:49.084538 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Jul 28 03:30:49 2021] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:30:49.096616 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-b4497893-ff89-43f6-90b2-4aea2ea8a13e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:30:49.119721 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-b4497893-ff89-43f6-90b2-4aea2ea8a13e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026768 Jul 28 03:30:49.120418 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Jul 28 03:30:49 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:31:28.384796 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-d9938daf-d641-4468-bf58-31ee29d85bbe admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:28.385774 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-d9938daf-d641-4468-bf58-31ee29d85bbe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 28 03:31:28.386176 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:31:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:31:28.441223 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-c752391b-be57-4465-b30f-fe1e54f49326 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:28.458718 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-c752391b-be57-4465-b30f-fe1e54f49326 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066167 Jul 28 03:31:28.459243 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Jul 28 03:31:28 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:31:29.869425 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-d9938daf-d641-4468-bf58-31ee29d85bbe admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:29.870453 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-d9938daf-d641-4468-bf58-31ee29d85bbe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jul 28 03:31:29.870841 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:31:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:31:30.058220 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-ab0948e2-6502-4ac1-85fd-67838f15b71d admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:30.064457 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.wsgi [None req-ab0948e2-6502-4ac1-85fd-67838f15b71d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 03:31:30.065021 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-ab0948e2-6502-4ac1-85fd-67838f15b71d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:31:30.065818 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-ab0948e2-6502-4ac1-85fd-67838f15b71d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.058678 Jul 28 03:31:30.066326 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Jul 28 03:31:30 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 03:31:30.075960 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-1eab2766-4054-43a7-8b8a-7ced050b730d admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:30.096928 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-1eab2766-4054-43a7-8b8a-7ced050b730d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024468 Jul 28 03:31:30.097445 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Jul 28 03:31:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:31:30.107168 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-304e9798-946f-41b8-ac9f-b8a43c132290 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:30.128785 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-304e9798-946f-41b8-ac9f-b8a43c132290 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024988 Jul 28 03:31:30.129341 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Jul 28 03:31:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:31:30.139940 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-966a79b4-67ea-4b2d-8d64-e5b889cf42a7 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:30.145390 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.wsgi [None req-966a79b4-67ea-4b2d-8d64-e5b889cf42a7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 03:31:30.145958 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-966a79b4-67ea-4b2d-8d64-e5b889cf42a7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:31:30.146729 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-966a79b4-67ea-4b2d-8d64-e5b889cf42a7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.011120 Jul 28 03:31:30.147211 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Jul 28 03:31:30 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 03:31:31.489866 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-304e9798-946f-41b8-ac9f-b8a43c132290 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:31.490891 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-304e9798-946f-41b8-ac9f-b8a43c132290 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jul 28 03:31:31.491275 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:31:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:31:31.681827 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-4f0837e7-a67c-4c66-8ec2-f6bcc9181319 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:31.687466 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.wsgi [None req-4f0837e7-a67c-4c66-8ec2-f6bcc9181319 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 03:31:31.688067 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-4f0837e7-a67c-4c66-8ec2-f6bcc9181319 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:31:31.688842 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-4f0837e7-a67c-4c66-8ec2-f6bcc9181319 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.056610 Jul 28 03:31:31.689337 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Jul 28 03:31:31 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:31.698957 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-00e55380-5069-4d76-90a2-5a620f99d571 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:31.712921 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-00e55380-5069-4d76-90a2-5a620f99d571 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017508 Jul 28 03:31:31.713436 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Jul 28 03:31:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:31:31.723550 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-afdfc541-6a13-4ad3-a7ec-6d6b7324a87c admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:31.737455 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-afdfc541-6a13-4ad3-a7ec-6d6b7324a87c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017344 Jul 28 03:31:31.737995 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Jul 28 03:31:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:31:31.747650 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-f1624a4c-a049-4c4c-8603-e8630e716880 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:31.753281 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.wsgi [None req-f1624a4c-a049-4c4c-8603-e8630e716880 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 03:31:31.753846 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-f1624a4c-a049-4c4c-8603-e8630e716880 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:31:31.754618 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-f1624a4c-a049-4c4c-8603-e8630e716880 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010418 Jul 28 03:31:31.755100 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1191 bytes} [Wed Jul 28 03:31:31 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:33.094989 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-afdfc541-6a13-4ad3-a7ec-6d6b7324a87c admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:33.096020 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-afdfc541-6a13-4ad3-a7ec-6d6b7324a87c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 28 03:31:33.096437 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:31:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:31:33.292586 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-3e0e26aa-f8f5-4b6e-b046-7f5f7e6fec63 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:33.299662 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.wsgi [None req-3e0e26aa-f8f5-4b6e-b046-7f5f7e6fec63 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 03:31:33.300291 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-3e0e26aa-f8f5-4b6e-b046-7f5f7e6fec63 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:31:33.301077 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-3e0e26aa-f8f5-4b6e-b046-7f5f7e6fec63 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.060084 Jul 28 03:31:33.301576 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Jul 28 03:31:33 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:33.312327 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-5ae807a7-a19f-4459-bfd5-747c1478763c admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:33.325322 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-5ae807a7-a19f-4459-bfd5-747c1478763c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017680 Jul 28 03:31:33.325824 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Jul 28 03:31:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:31:33.335780 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:33.349402 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016979 Jul 28 03:31:33.349921 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1211 bytes} [Wed Jul 28 03:31:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:31:33.360325 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-c8936985-8c27-477a-ba56-78a25ff87790 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:33.365335 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.wsgi [None req-c8936985-8c27-477a-ba56-78a25ff87790 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 03:31:33.365895 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-c8936985-8c27-477a-ba56-78a25ff87790 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:31:33.366685 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-c8936985-8c27-477a-ba56-78a25ff87790 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010808 Jul 28 03:31:33.367159 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Jul 28 03:31:33 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:31:34.718232 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:34.719256 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 28 03:31:34.719649 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:31:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:31:34.907996 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-2de295df-a5f5-4bf9-95c3-b03934873e16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:31:34.926759 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-2de295df-a5f5-4bf9-95c3-b03934873e16 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.069763 Jul 28 03:31:34.927220 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1236 bytes} [Wed Jul 28 03:31:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:31:36.262389 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:36.263420 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 28 03:31:36.264464 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:31:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:31:36.452667 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-58eece3b-ce88-4789-ac97-ac843a972439 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:31:36.469746 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-58eece3b-ce88-4789-ac97-ac843a972439 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.065522 Jul 28 03:31:36.470280 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1236 bytes} [Wed Jul 28 03:31:36 2021] POST /compute/v2.1/flavors => generated 405 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:31:37.815471 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:37.816527 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 28 03:31:37.816920 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:31:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:31:38.003465 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-f0f6954d-6045-4525-819a-0a0bce27d043 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:31:38.020428 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-f0f6954d-6045-4525-819a-0a0bce27d043 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.065389 Jul 28 03:31:38.020958 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1236 bytes} [Wed Jul 28 03:31:37 2021] POST /compute/v2.1/flavors => generated 407 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:31:39.353977 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:39.354975 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 28 03:31:39.355361 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:31:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:31:39.544053 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-78092337-0fa6-4068-89eb-11a31ea46edc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:31:39.561372 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-78092337-0fa6-4068-89eb-11a31ea46edc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.066500 Jul 28 03:31:39.561896 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1236 bytes} [Wed Jul 28 03:31:39 2021] POST /compute/v2.1/flavors => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:31:40.894864 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:40.895910 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jul 28 03:31:40.896305 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:31:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:31:41.083829 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-d6e21e39-a46c-4d88-9236-1194f275d688 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:31:41.102701 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-d6e21e39-a46c-4d88-9236-1194f275d688 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.067168 Jul 28 03:31:41.103222 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1203 bytes} [Wed Jul 28 03:31:41 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:32:27.536097 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:32:27.537168 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-12d16645-4a70-4b09-959a-df814313b255 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 28 03:32:27.537579 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Wed Jul 28 03:32:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:32:27.593359 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-1e4bda02-2ba4-4418-b21c-5ed5ca81d9bb admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:32:27.612521 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-1e4bda02-2ba4-4418-b21c-5ed5ca81d9bb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068601 Jul 28 03:32:27.613040 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Jul 28 03:32:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:32:27.635249 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-469023cd-e380-49ad-a854-22ed55d238f8 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:32:27.642936 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-469023cd-e380-49ad-a854-22ed55d238f8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011196 Jul 28 03:32:27.643439 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Jul 28 03:32:27 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:32:27.654530 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-1c21d7c9-993c-4b53-9467-3b8746423a0a admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:32:27.661797 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-1c21d7c9-993c-4b53-9467-3b8746423a0a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010713 Jul 28 03:32:27.662295 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Jul 28 03:32:27 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:32:27.673923 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-1eeea5d2-721d-4a26-ae14-dd64dbb71883 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:32:27.681086 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-1eeea5d2-721d-4a26-ae14-dd64dbb71883 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010480 Jul 28 03:32:27.681581 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Jul 28 03:32:27 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:32:27.693428 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-eddc6fa1-1283-4b87-afd2-4fd3830d18a2 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:32:27.700691 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-eddc6fa1-1283-4b87-afd2-4fd3830d18a2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010532 Jul 28 03:32:27.701195 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Jul 28 03:32:27 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:33:48.500326 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-b19a295a-4d05-4a27-bdad-c4c83126ff35 tempest-verify_tempest_config-1293855963 tempest-verify_tempest_config-1293855963-project] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:33:48.502287 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-b19a295a-4d05-4a27-bdad-c4c83126ff35 tempest-verify_tempest_config-1293855963 tempest-verify_tempest_config-1293855963-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.103847 Jul 28 03:33:48.502806 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 34/69] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Jul 28 03:33:48 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:18.552183 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-eddc6fa1-1283-4b87-afd2-4fd3830d18a2 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:18.553257 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-eddc6fa1-1283-4b87-afd2-4fd3830d18a2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 28 03:35:18.553675 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 36/70] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:35:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:18.811284 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-16f46151-f24d-4faa-a76f-abafd0dff0f9 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:18.812458 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:18.812458 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: warnings.warn(msg) Jul 28 03:35:18.814302 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-16f46151-f24d-4faa-a76f-abafd0dff0f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:35:18.814757 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-16f46151-f24d-4faa-a76f-abafd0dff0f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:35:18.815550 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-16f46151-f24d-4faa-a76f-abafd0dff0f9 admin admin] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:35:18.816004 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-16f46151-f24d-4faa-a76f-abafd0dff0f9 admin admin] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:35:18.849133 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-16f46151-f24d-4faa-a76f-abafd0dff0f9 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.88 time: 0.151829 Jul 28 03:35:18.849703 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 35/71] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Jul 28 03:35:18 2021] GET /compute/v2.1/os-services => generated 794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:20.192795 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-eddc6fa1-1283-4b87-afd2-4fd3830d18a2 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:20.193796 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-eddc6fa1-1283-4b87-afd2-4fd3830d18a2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 28 03:35:20.194189 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:35:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:20.386858 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-815d6a38-24a4-42a9-ba05-06942b23237e admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:20.388041 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:20.388041 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: warnings.warn(msg) Jul 28 03:35:20.389582 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-815d6a38-24a4-42a9-ba05-06942b23237e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:35:20.390024 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-815d6a38-24a4-42a9-ba05-06942b23237e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:35:20.390811 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-815d6a38-24a4-42a9-ba05-06942b23237e admin admin] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:35:20.391243 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-815d6a38-24a4-42a9-ba05-06942b23237e admin admin] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:35:20.409795 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-815d6a38-24a4-42a9-ba05-06942b23237e admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.88 time: 0.076840 Jul 28 03:35:20.410520 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 36/73] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Jul 28 03:35:20 2021] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:32.203461 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-eddc6fa1-1283-4b87-afd2-4fd3830d18a2 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:32.204540 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-eddc6fa1-1283-4b87-afd2-4fd3830d18a2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 28 03:35:32.204930 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:35:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:32.394522 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-489041d2-084e-4c26-81a5-f3e96f000d1f admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:32.395666 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:32.395666 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: warnings.warn(msg) Jul 28 03:35:32.397221 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-489041d2-084e-4c26-81a5-f3e96f000d1f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:35:32.397661 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-489041d2-084e-4c26-81a5-f3e96f000d1f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:35:32.398444 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-489041d2-084e-4c26-81a5-f3e96f000d1f admin admin] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:35:32.398872 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-489041d2-084e-4c26-81a5-f3e96f000d1f admin admin] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:35:32.422284 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-489041d2-084e-4c26-81a5-f3e96f000d1f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.88 time: 0.076961 Jul 28 03:35:32.422817 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 37/75] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Jul 28 03:35:32 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:35:33.768925 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: DEBUG nova.api.openstack.wsgi [None req-eddc6fa1-1283-4b87-afd2-4fd3830d18a2 admin admin] Calling method '>' {{(pid=92536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:33.769919 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: INFO nova.api.openstack.requestlog [None req-eddc6fa1-1283-4b87-afd2-4fd3830d18a2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jul 28 03:35:33.770319 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: [pid: 92536|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1075 bytes} [Wed Jul 28 03:35:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:33.961046 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG nova.api.openstack.wsgi [None req-9bede3d4-7e3f-4def-8fa8-3411bd6a5460 admin admin] Calling method '>' {{(pid=92537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:33.962186 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:33.962186 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: warnings.warn(msg) Jul 28 03:35:33.963680 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-9bede3d4-7e3f-4def-8fa8-3411bd6a5460 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:35:33.964148 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-9bede3d4-7e3f-4def-8fa8-3411bd6a5460 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:35:33.964967 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-9bede3d4-7e3f-4def-8fa8-3411bd6a5460 admin admin] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:35:33.965875 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: DEBUG oslo_concurrency.lockutils [None req-9bede3d4-7e3f-4def-8fa8-3411bd6a5460 admin admin] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:35:33.987447 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: INFO nova.api.openstack.requestlog [None req-9bede3d4-7e3f-4def-8fa8-3411bd6a5460 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.88 time: 0.074673 Jul 28 03:35:33.987948 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: [pid: 92537|app: 0|req: 38/77] 10.222.0.16 () {60 vars in 1194 bytes} [Wed Jul 28 03:35:33 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:36:29.946967 dv-cinder-733062-21-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 03:36:29.947491 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: Wed Jul 28 03:36:29 2021 - graceful shutdown triggered... Jul 28 03:36:29.947968 dv-cinder-733062-21-iscsi devstack@n-api.service[92536]: Gracefully killing worker 1 (pid: 92536)... Jul 28 03:36:29.948347 dv-cinder-733062-21-iscsi devstack@n-api.service[92537]: Gracefully killing worker 2 (pid: 92537)... Jul 28 03:36:30.948552 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: worker 1 buried after 1 seconds Jul 28 03:36:30.948552 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: worker 2 buried after 1 seconds Jul 28 03:36:30.948552 dv-cinder-733062-21-iscsi devstack@n-api.service[92535]: goodbye to uWSGI. Jul 28 03:36:30.950086 dv-cinder-733062-21-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 03:36:30.950667 dv-cinder-733062-21-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 03:36:30.953607 dv-cinder-733062-21-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 03:36:30.963740 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 28 03:36:30 2021] *** Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: nodename: dv-cinder-733062-21-iscsi Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: machine: x86_64 Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: clock source: unix Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: pcre jit disabled Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: detected number of CPU cores: 4 Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: current working directory: / Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: detected binary path: /usr/bin/uwsgi-core Jul 28 03:36:30.965734 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: your processes number limit is 47680 Jul 28 03:36:30.966964 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: your memory page size is 4096 bytes Jul 28 03:36:30.966964 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: detected max file descriptor number: 2048 Jul 28 03:36:30.966964 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: lock engine: pthread robust mutexes Jul 28 03:36:30.966964 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: thunder lock: enabled Jul 28 03:36:30.966964 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 03:36:30.967269 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 28 03:36:31.012227 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: Python main interpreter initialized at 0x55dcb03189c0 Jul 28 03:36:31.012227 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: python threads support enabled Jul 28 03:36:31.012227 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: your server socket listen backlog is limited to 100 connections Jul 28 03:36:31.012227 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: your mercy for graceful operations on workers is 90 seconds Jul 28 03:36:31.012678 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 03:36:31.012678 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: *** Operational MODE: preforking *** Jul 28 03:36:31.013017 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: *** uWSGI is running in multiple interpreter mode *** Jul 28 03:36:31.013017 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: spawned uWSGI master process (pid: 119140) Jul 28 03:36:31.013229 dv-cinder-733062-21-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 03:36:31.013965 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: spawned uWSGI worker 1 (pid: 119154, cores: 1) Jul 28 03:36:31.014488 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: spawned uWSGI worker 2 (pid: 119155, cores: 1) Jul 28 03:36:31.014778 dv-cinder-733062-21-iscsi devstack@n-api.service[119140]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 03:36:32.843997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:36:32.843997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: from cryptography.utils import int_from_bytes Jul 28 03:36:32.845252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:36:32.845252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: from cryptography.utils import int_from_bytes Jul 28 03:36:32.848717 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:36:32.848717 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: from cryptography.utils import int_from_bytes Jul 28 03:36:32.849234 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:36:32.849234 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: from cryptography.utils import int_from_bytes Jul 28 03:36:35.356012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:36:35.356697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:36:35.356861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:36:35.357176 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:36:35.357442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:36:35.357828 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.358158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.358483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.358804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.359140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.359456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.359803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.360129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.360461 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.360731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.361046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.361284 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:36:35.361654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-21-iscsi {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.361736 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:36:35.361813 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.361988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.362091 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:36:35.362297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.362421 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:36:35.362611 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:36:35.362791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.362958 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.363055 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.363241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.363357 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.363550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.363665 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.363958 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.364067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.364285 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.364601 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.364925 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.365327 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.365572 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.365814 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.366022 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.366240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.366456 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.366672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.366873 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-21-iscsi {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.367088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.367300 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.367506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.367753 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.368012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.368216 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.368420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.368637 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.368861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.369097 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.369301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.369504 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.369718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.369929 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.370146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-21-iscsi {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.370351 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.370554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.370774 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.370918 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.371100 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.371251 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.371429 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.371585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.371758 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.371917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.372609 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.372805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.372953 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.373105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.373252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.373431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.373591 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.373737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.373918 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.374084 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.375616 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.375818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.375976 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-21-iscsi {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.376177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.376347 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.376533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.376711 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.376860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.377017 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.377165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.377165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.377449 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.377598 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.377749 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.377906 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.378053 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.378215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.378356 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.378502 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.378642 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.378793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.378942 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.379083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.379228 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.379382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.379537 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.379747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.379913 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.380074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.380216 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.380355 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.380505 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.380651 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.380792 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.380931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.381070 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.381228 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.381369 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.381523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.381662 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.381819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.381966 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.382122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.382263 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.382409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.382555 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.382694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.382839 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.382987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.383132 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.383273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.383412 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.383571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.383811 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.383976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.384127 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.384275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.384423 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.384569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.384726 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.384874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.385043 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.385882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.386036 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.386185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.386355 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.386506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.386647 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.386793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.386942 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.387082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.387304 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.388397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.388574 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.388718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.388877 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.389123 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.389290 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.389435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.389749 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.389896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.390045 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.390199 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.390356 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.390456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.390540 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.390621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.390710 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.390811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.390939 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.391024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.391117 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.391207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.391207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.391377 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.391480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.391621 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.391729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.391825 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.391921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392004 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392172 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392254 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392340 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392518 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392698 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392868 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.392957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393039 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393219 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393397 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393643 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393803 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.393972 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394149 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394238 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394327 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394503 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394592 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394678 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394760 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394846 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.394934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.395028 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.395118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.395200 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.395306 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.395676 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.395971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396065 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396263 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396355 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396443 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396613 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396772 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.396955 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397044 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397135 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397309 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397486 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397653 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397732 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397825 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.397988 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.398129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.398226 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.398435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.398542 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.398745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.398847 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.399056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.399153 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.399363 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.399457 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.399667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.399805 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.400011 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.400099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.400314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.400403 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.400634 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.400729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.400939 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.401041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.401252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.401347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.401560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.401648 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.401871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.401961 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.402179 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.402266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.402487 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.402583 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.402795 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.402892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.403107 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.403196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.403442 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.403537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.403773 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.403993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.404093 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.404337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.404435 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.404663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.404761 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.404982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.405072 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.405295 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.405385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.405683 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.405799 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.405907 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.406154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.406260 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:36:35.406352 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.406533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.406630 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.406856 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.406954 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.407177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.407283 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.407513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.407611 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.407865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.407973 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.408191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.408292 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.408514 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.408609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.408827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.408929 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.409144 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.409239 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.409476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.409579 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.409813 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.409904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.410105 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.410204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.410450 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.410539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.410746 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.410835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.411086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.411417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.411753 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.411890 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.412085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.412244 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.412404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.412580 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.412720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.412912 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.413036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.413239 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.413356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.413562 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.413669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.413890 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.413969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.414230 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.414310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.414631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.414763 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.414950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.415068 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.415260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.415362 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.415569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.415907 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.415999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.416105 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.416286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.416383 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.416584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.416703 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.416911 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.417015 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.417244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.417336 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.417555 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.417646 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.417881 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.417980 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.418200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.418306 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.418513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.418611 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.418828 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.418956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.419286 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.419416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.419614 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.419728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.420649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.420774 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.420849 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.420919 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.420995 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.421072 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.421156 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.421234 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.421315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.421413 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.421495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.421576 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.421784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.421878 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.422094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.422184 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.422412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.422501 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.422727 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.422818 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.423042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.423132 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.423359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.423461 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.423689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.423832 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.424035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.424126 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.424350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.424457 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.424663 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.424760 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.424975 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.425064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.425303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.425405 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.425617 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.425712 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.425930 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.426046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.426259 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.426385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.426568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.426680 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.426873 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.426969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.427180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.427270 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.427488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.427586 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.427821 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.427915 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.428137 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.428234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.428442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.428537 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.428751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.428842 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.429062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.429152 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.429368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.429459 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.429675 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.429771 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.430002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.430099 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.430316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.430414 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.430623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.430726 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.430931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.431067 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.431246 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.431341 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.431546 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.431646 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.431882 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.431975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.432193 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.432290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.432504 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.432603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.432818 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.432915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.433127 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.433217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.433438 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.433541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.433748 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.433838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.434055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.434149 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.434359 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.434448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.435200 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.435296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.435517 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.435833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.435955 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.436149 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.436252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.436488 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.436579 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.436765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.436876 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.437089 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.437181 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.437427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.437524 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.437744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.437844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.438058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.438147 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.438382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.438473 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.438695 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.438784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.439005 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.439102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.439316 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.439412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.439622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.439728 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.439959 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.440062 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.440272 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.440368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.440587 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.440677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.440896 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.440994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.441210 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.441299 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.441520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.441610 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.441839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.441929 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.442155 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.442245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.442467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.442565 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.442775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.442872 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.443088 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.443185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.443403 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.443502 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.443793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.443888 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.444052 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.444155 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.444363 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.444459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.444676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.444764 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.444983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.445082 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.445296 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.445384 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.445611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.445709 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.445918 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.446014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.446227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.446327 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.446528 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.446656 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.446840 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.446933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.447147 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.447249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.447460 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.447551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.447801 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.447893 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.448124 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.448223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.448439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.448527 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.448756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.448847 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.449065 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.449151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.449373 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.449462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.449695 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.449798 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.450008 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.450103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.450370 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.450506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.450680 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.450832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.450993 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.451154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.451344 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.452008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.452096 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.452176 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.452248 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.452317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.452396 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.452468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.452606 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.452704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.452919 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.453011 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.453240 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.453331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.453556 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.453657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.453868 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.453969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.454193 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.454496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.454677 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.454805 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.454889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.455131 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.455248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.455439 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.455542 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.455773 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.455870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.456090 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.456192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.456421 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.456532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.456737 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.456848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.457051 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.457161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.457407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.457510 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.457661 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.457748 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.457971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.458068 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.458282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.458373 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.458602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.458860 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.458948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.459204 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.459302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.459510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.459605 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.459848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.459942 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.460160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.460251 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.460470 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.460559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.460780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.460871 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.461089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.461186 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.461405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.461494 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.461714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.461802 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.462030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.462126 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.462338 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.462426 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.462647 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.462741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.462962 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.463052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.463265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.463360 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.463573 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.463677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.463904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.464006 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.464219 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.464319 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.464527 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.464645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.464838 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.464943 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.465144 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.465232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.465453 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.465556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.466291 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.466398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.466641 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.466823 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.466975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.467284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.467380 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.467591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.467685 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.467927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.468035 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.468241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.468334 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.468817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.468908 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.469125 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.469301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.469437 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.469534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.469746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.469834 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.470060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.470159 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.470374 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.470462 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.470681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.470771 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.470992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.471091 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.471302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.471400 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.471620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.471767 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.471958 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.472057 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.472266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.472364 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.472573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.472670 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.472888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.472977 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.473199 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.473287 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.473505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.473595 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.473810 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.473898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.474115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.474211 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.474432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.474530 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.474742 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.474843 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.475049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.475140 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.475354 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.475441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.475664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.475787 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.476001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.476092 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.476309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.476405 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.476661 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.476770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.476928 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.477042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.477240 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.477337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.477552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.477643 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.477860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.477953 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.478167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.478256 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.478479 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.478569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.478785 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.478874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.479104 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.479201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.479409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.479511 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.479750 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.479844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.480043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.480142 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.480353 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.480448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.480660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.480749 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.480962 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.481058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.481268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.481364 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.482177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.482278 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.482493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.482597 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.482805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.482902 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.483114 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.483211 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.483442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.483540 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.483790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.483917 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.484103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.484260 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.484413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.484585 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.484718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.484896 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.485065 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.485213 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.485375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.485523 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.485736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.485826 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.486047 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.486144 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.486366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.486456 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.486688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.486798 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.487044 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.487155 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.487314 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.487404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.487621 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.487744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.487952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.488054 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.488271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.488360 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.488584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.488674 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.488891 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.488991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.489200 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.489290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.489504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.489599 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.489829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.489935 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.490144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.490242 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.490459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.490556 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.490785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.490884 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.491107 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.491195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.491430 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.491527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.491767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.491887 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.492071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.492162 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.492385 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.492473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.492692 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.492783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.493004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.493093 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.493316 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.493412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.493630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.493727 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.493935 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.494023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.494240 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.494332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.494553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.494644 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.494867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.494965 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.495178 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.495274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.495489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.495586 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.495827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.495923 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.496140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.496308 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.496460 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.496550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.496771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.496860 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.497151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.497264 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.497415 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.497505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.497724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.497813 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.498039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.498178 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.498349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.498447 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.498729 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.498866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.499045 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.499145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.499362 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.499459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.499679 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.499838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.500016 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.500115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.500328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.500423 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.500640 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.500730 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.500950 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.501049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.501257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.501347 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.501581 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.501676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.501890 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.501981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.502204 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.502302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.502512 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.502603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.502826 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.502925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.503133 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.503222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.503481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.503583 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.503844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.503940 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.504161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.504259 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.504472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.504571 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.504783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.504874 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.505098 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.505187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.505411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.505512 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.505725 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.505813 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.506035 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.506152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.506457 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.506556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.506774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.506863 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.507092 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.507224 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.507409 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.507524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.507725 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.507875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.508047 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.508180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.508369 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.508463 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.508700 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.508797 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.509011 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.509102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.509321 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.509415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.509630 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.509720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.509958 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.510055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.510267 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.510358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.510594 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.510691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.510939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.511036 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.511251 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.511347 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.511581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.511679 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.511938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.512069 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.512260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.512387 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.512589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.512738 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.513037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.513155 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.513366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.513463 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.513681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.513778 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.513994 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.514096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.514314 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.514405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.514624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.514712 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.514934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.515025 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.515251 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.515350 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.515560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.515650 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.515898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.515991 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.516207 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.516295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.516530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.516617 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.516847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.516944 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.517167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.517277 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.517481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.517589 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.517789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.517881 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.518099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.518217 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.518428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.518525 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.518744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.518834 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.519073 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.519168 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.519393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.519492 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.519741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.519846 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.520071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.520169 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.520383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.520482 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.520690 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.520786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.521017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.521112 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.521326 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.521428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.521636 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.521726 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.521945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.522042 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.522256 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.522351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.522565 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.522662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.522876 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.522975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.523204 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.523302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.523513 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.523610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.523866 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.523960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.524189 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.524294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.524516 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.524606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.524835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.524925 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.525144 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.525240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.525471 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.525561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.525778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.525868 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.526085 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.526180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.526392 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.526488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.526696 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.526785 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.527004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.527101 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.527328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.527432 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.527640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.527770 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.527926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.528037 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.528235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.528874 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.529054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.529156 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.529384 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.529489 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.529695 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.529798 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.530022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.530164 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.530337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.530435 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.530645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.530744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.530966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.531057 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.531273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.531395 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.531620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.531743 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.531951 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.532051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.532261 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.532347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.532567 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.532658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.532879 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.532974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.533186 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.533276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.533498 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.533591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.533809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.533906 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.534136 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.534226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.534444 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.534534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.534768 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.534858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.535081 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.535179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.535390 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.535487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.535734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.535826 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.536040 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.536138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.536357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.536447 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.536689 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.536805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.537018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.537136 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.537342 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.537456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.537672 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.537868 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.538008 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.538201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.538323 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.538521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.538660 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.538840 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.538981 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.539165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.539287 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.539490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.539608 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.539834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.539942 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.540154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.540245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.540472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.540569 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.540787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.540887 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.541102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.541200 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.541432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.541521 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.541765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.541868 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.542083 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.542172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.542446 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.542610 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.542771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.542944 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.543092 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.543263 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.543412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.543580 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.543761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.544004 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.544768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.545002 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.545099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.545196 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.545404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.545501 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.545734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.545832 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.546062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.546161 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.546387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.546478 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.546711 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.546809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.547033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.547135 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.547355 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.547507 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.547685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.547827 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.548034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.548139 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.548351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.548480 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.548674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.548772 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.548998 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.549132 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.549333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.549433 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.549677 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.549775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.549992 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.550092 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.550309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.550406 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.550630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.550733 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.550953 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.551043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.551275 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.551477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.551594 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.551822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.551929 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.552163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.552255 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.552495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.552594 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.552826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.552924 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.553152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.553242 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.553472 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.553568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.553802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.553905 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.554114 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.554205 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.554424 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.554527 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.554737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.554835 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.555050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.555147 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.555357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.555460 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.555684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.555903 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.556023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.556223 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.556395 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.556559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.556650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.556888 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.556994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.557218 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.557469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.557609 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.557831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.557947 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.558158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.558269 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.558470 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.558560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.558778 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.558875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.559092 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.559226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.559403 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.559519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.559774 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.559970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.560194 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.560318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.560418 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.560638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.560734 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.560966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.561064 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.561291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.561382 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.561604 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.561841 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.561931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.562200 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.562343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.562529 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.562627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.562837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.562934 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.563154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.563245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.563465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.563810 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.563810 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.564043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.564149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.564240 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.564423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.564514 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.564735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.564833 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.565056 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.565155 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.565366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.565463 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.565674 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.565770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.565981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.566080 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.566290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.566380 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.566603 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.566705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.566909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.566998 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.567222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.567313 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.567529 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.567661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.567884 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.568094 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.568201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.568288 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.568479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.568647 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.568790 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.568888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.569108 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.569200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.569419 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.569525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.569725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.569821 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.570033 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.570129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.570341 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.570432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.570659 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.570756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.570968 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.571058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.571280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.571370 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.571588 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.571845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.571952 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.572173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.572273 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.572525 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.572714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.572834 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.573057 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.573154 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.573387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.573479 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.573738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.573826 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.574062 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.574159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.574383 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.574518 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.574686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.574787 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.575001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.575626 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.575854 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.576014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.576395 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.576487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.576721 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.576889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.577043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.577261 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.577351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.577603 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.577695 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.577932 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.578024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.578282 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.578386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.578598 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.578703 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.578916 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.579017 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.579229 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.579318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.579539 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.579642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.579894 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.579986 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.580214 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.580306 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.580531 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.580641 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.580848 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.580952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.581165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.581288 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.581479 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.581569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.581791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.581881 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.582105 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.582257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.582422 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.582694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.582804 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.582891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.583041 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.583140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.583366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.583464 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.583700 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.583865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.584044 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.584149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.584367 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.584464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.584688 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.584784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.585070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.585173 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.585399 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.585496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.585719 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.585809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.586049 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.586152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.586369 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.586467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.586683 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.586774 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.586995 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.587095 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.587308 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.587398 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.587623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.587773 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.588001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.588106 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.588347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.588449 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.588670 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.588768 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.588995 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.589085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.589324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.589413 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.589647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.589737 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.589963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.590063 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.590281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.590371 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.590598 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.590690 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.591450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.591558 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.591876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.591978 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.592200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.592309 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.592530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.592621 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.592848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.592946 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.593181 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.593281 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.593772 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.593866 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.594099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.594189 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.594409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.594512 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.594731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.594821 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.595046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.595143 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.595361 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.595463 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.595681 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.595814 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.596029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.596128 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.596346 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.596443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.596663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.596760 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.596978 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.597075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.597290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.597381 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.597615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.597706 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.597938 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.598035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.598250 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.598393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.598566 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.598673 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.598882 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.598972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.599203 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.599297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.599523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.599620 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.599865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.599978 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.600181 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.600279 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.600496 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.600591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.600808 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.600912 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.601123 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.601213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.601451 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.601549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.601761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.601866 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.602087 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.602189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.602406 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.602504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.602730 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.602832 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.603049 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.603145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.603360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.603450 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.603676 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.603818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.604017 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.604107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.604334 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.604435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.604644 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.604735 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.604961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.605058 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.605287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.605379 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.605599 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.605689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.605926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.606058 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.606245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.606349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.606676 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.606770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.606999 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.607107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.607316 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.607495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.607649 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.607784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.607994 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.608091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.608312 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.608415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.608604 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:36:35.608748 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.608931 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.609252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.609573 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.609903 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.610234 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.610566 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.610897 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.611247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.611565 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.611955 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.612290 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:36:35.612539 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:36:35.631969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_db.sqlalchemy.engines [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:36:35.635555 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_db.sqlalchemy.engines [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:36:35.800549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.context [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9a031e6-2f7b-43a5-9c59-929dc71d7c62(cell1) {{(pid=119154) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:36:35.803652 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.context [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9a031e6-2f7b-43a5-9c59-929dc71d7c62(cell1) {{(pid=119155) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:36:35.804829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:36:35.806437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:36:35.807266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:36:35.807913 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:36:35.809256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:36:35.809555 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:36:35.810389 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:36:35.812385 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:36:35.819553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_db.sqlalchemy.engines [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:36:35.820492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_db.sqlalchemy.engines [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:36:35.823776 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_db.sqlalchemy.engines [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:36:35.824895 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_db.sqlalchemy.engines [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:36:36.093767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_db.sqlalchemy.engines [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:36:36.102289 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_db.sqlalchemy.engines [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:36:36.424899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: WARNING keystonemiddleware.auth_token [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:36:36.431554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: WARNING keystonemiddleware.auth_token [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:36:36.441784 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: WARNING keystonemiddleware.auth_token [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:36:36.448267 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: WARNING keystonemiddleware.auth_token [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:36:36.782449 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: WARNING keystonemiddleware.auth_token [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:36:36.787561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: WARNING keystonemiddleware.auth_token [None req-9fa0af2d-2885-4f3c-b416-0fcc30e7a870 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:36:36.792916 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dcb03189c0 pid: 119154 (default app) Jul 28 03:36:36.808292 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: WARNING keystonemiddleware.auth_token [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:36:36.814507 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: WARNING keystonemiddleware.auth_token [None req-2731bc87-d5bb-43ee-a26f-f682790f3d66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:36:36.819975 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dcb03189c0 pid: 119155 (default app) Jul 28 03:37:09.864664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-57334e0d-c8c5-4a48-beba-ba7a8c2d6575 tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] Action: 'create', calling method: .version_select at 0x7f680889f160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1221325791", "metadata": {"Type": "work"}}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:09.913210 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-55418d1d-b1ad-49f2-a89c-a82f276617d2 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Action: 'create', calling method: .version_select at 0x7f680889f160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-786348159", "metadata": {"Type": "work"}}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:09.914917 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-55418d1d-b1ad-49f2-a89c-a82f276617d2 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:37:09.915877 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-55418d1d-b1ad-49f2-a89c-a82f276617d2 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.120071 Jul 28 03:37:09.920974 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Jul 28 03:37:08 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:37:10.185844 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-823138086", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "networks": [{"uuid": "8c23bd5e-8fc0-4f7d-91cc-6a5fe58dd67b"}]}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:10.691810 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.network.neutron [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] validate_networks() for [('8c23bd5e-8fc0-4f7d-91cc-6a5fe58dd67b', None, None, None)] {{(pid=119155) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:37:11.496456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-57334e0d-c8c5-4a48-beba-ba7a8c2d6575 tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.863446 Jul 28 03:37:11.497200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Jul 28 03:37:08 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2866 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 03:37:11.891689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-550585570", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "networks": [{"uuid": "907c8c72-fbe1-4216-965a-39395c1cad68"}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:12.042971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] validate_networks() for [('907c8c72-fbe1-4216-965a-39395c1cad68', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:37:12.394164 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Flavor limits 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:12.394759 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Image limits 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:12.395282 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Flavor pref 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:12.395690 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Image pref 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:12.396319 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:12.425318 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:12.425769 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:12.426808 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:12.427450 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:12.468457 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.quota [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Getting quotas for project 0e3e648ccf87421d9660e75180c946bd. Resources: {'ram', 'cores', 'instances'} {{(pid=119155) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:37:12.485852 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.quota [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Getting quotas for user 17af4a654a6843e5a04c396917f60365 and project 0e3e648ccf87421d9660e75180c946bd. Resources: {'ram', 'cores', 'instances'} {{(pid=119155) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:37:12.500392 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Going to run 1 instances... {{(pid=119155) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:37:12.503556 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119155) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:37:12.650910 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-3f345c12-d7fd-4016-901a-d7a2718712e6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.723655 Jul 28 03:37:12.652237 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:37:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 2731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:37:12.658586 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2692aac4-e65a-4b2c-aa31-cf6af53cf24b tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Action: 'create', calling method: .version_select at 0x7f680869bca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-340314967", "metadata": {"Type": "work"}}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:12.660487 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2692aac4-e65a-4b2c-aa31-cf6af53cf24b tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:37:12.661768 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2692aac4-e65a-4b2c-aa31-cf6af53cf24b tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007295 Jul 28 03:37:12.662809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 3/4] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Jul 28 03:37:12 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:37:12.671018 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1cde814c-ddbf-4325-ae1c-a8bb383d12d0 tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] Calling method '.version_select at 0x7f68086359d0>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:12.843966 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1cde814c-ddbf-4325-ae1c-a8bb383d12d0 tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/39a5e3a5-68fa-4f94-bc1f-3667892ea882" status: 200 len: 354 microversion: 2.1 time: 0.179555 Jul 28 03:37:12.844615 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 4/5] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Jul 28 03:37:12 2021] GET /compute/v2.1/os-volumes/39a5e3a5-68fa-4f94-bc1f-3667892ea882 => generated 354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:12.851619 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-3f2d1be7-7e95-4be1-8883-17283b8868c1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:12.852733 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-3f2d1be7-7e95-4be1-8883-17283b8868c1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:13.065623 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3f2d1be7-7e95-4be1-8883-17283b8868c1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:13.085527 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-3f2d1be7-7e95-4be1-8883-17283b8868c1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1214 microversion: 2.1 time: 0.238953 Jul 28 03:37:13.089262 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 5/6] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:12 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:13.109659 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fbd19a68-1eb6-47bf-ba65-c8998bdff7b5 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Action: 'create', calling method: .version_select at 0x7f680889f670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-155706456", "metadata": {"Type": "work"}}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:13.113906 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fbd19a68-1eb6-47bf-ba65-c8998bdff7b5 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:37:13.115198 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-fbd19a68-1eb6-47bf-ba65-c8998bdff7b5 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023818 Jul 28 03:37:13.126133 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 6/7] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Jul 28 03:37:13 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:37:13.131858 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a801f01a-f4b0-487c-b0a8-8dca70bc976d tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] Calling method '.version_select at 0x7f6807da5af0>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:13.222469 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a801f01a-f4b0-487c-b0a8-8dca70bc976d tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/39a5e3a5-68fa-4f94-bc1f-3667892ea882" status: 200 len: 354 microversion: 2.1 time: 0.095604 Jul 28 03:37:13.223110 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 7/8] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Jul 28 03:37:13 2021] GET /compute/v2.1/os-volumes/39a5e3a5-68fa-4f94-bc1f-3667892ea882 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:13.232252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2dca2609-bab0-4200-b975-fa560f85ad75 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Calling method '.version_select at 0x7f68086358b0>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:13.283577 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-2dca2609-bab0-4200-b975-fa560f85ad75 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] HTTP exception thrown: Volume tempest-invalid-1121603512 could not be found. Jul 28 03:37:13.284641 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2dca2609-bab0-4200-b975-fa560f85ad75 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Returning 404 to user: Volume tempest-invalid-1121603512 could not be found. {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:37:13.285734 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2dca2609-bab0-4200-b975-fa560f85ad75 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1121603512" status: 404 len: 99 microversion: 2.1 time: 0.061654 Jul 28 03:37:13.292618 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 8/9] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Jul 28 03:37:13 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1121603512 => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:37:13.310431 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-18a0bd10-4f6d-498e-90a1-f92e481d288f tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] Calling method '.version_select at 0x7f68086358b0>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:13.498818 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-18a0bd10-4f6d-498e-90a1-f92e481d288f tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/39a5e3a5-68fa-4f94-bc1f-3667892ea882" status: 202 len: 0 microversion: 2.1 time: 0.204053 Jul 28 03:37:13.500373 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 9/10] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Jul 28 03:37:13 2021] DELETE /compute/v2.1/os-volumes/39a5e3a5-68fa-4f94-bc1f-3667892ea882 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:37:13.506712 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0f362963-5296-4404-a228-c54158d98eff tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005037 Jul 28 03:37:13.514426 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 10/11] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Jul 28 03:37:13 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 03:37:13.522372 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d3063991-8021-4092-a824-1859a51f4566 tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] Calling method '.version_select at 0x7f6807da59d0>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:13.678590 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d3063991-8021-4092-a824-1859a51f4566 tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/39a5e3a5-68fa-4f94-bc1f-3667892ea882" status: 200 len: 353 microversion: 2.1 time: 0.162711 Jul 28 03:37:13.679559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 11/12] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Jul 28 03:37:13 2021] GET /compute/v2.1/os-volumes/39a5e3a5-68fa-4f94-bc1f-3667892ea882 => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:13.689410 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e8bf71a3-ca8f-4c1d-b0b4-81b5189ea5c4 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008481 Jul 28 03:37:13.696869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 12/13] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Jul 28 03:37:13 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 03:37:13.708488 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-37de3ebe-fa26-4d76-8778-3bb550d1eba7 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Calling method '.version_select at 0x7f6807db7430>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:13.796697 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-37de3ebe-fa26-4d76-8778-3bb550d1eba7 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] HTTP exception thrown: Volume 9e92df8f-eeb3-4094-87c6-33843f3bcb13 could not be found. Jul 28 03:37:13.797334 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-37de3ebe-fa26-4d76-8778-3bb550d1eba7 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Returning 404 to user: Volume 9e92df8f-eeb3-4094-87c6-33843f3bcb13 could not be found. {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:37:13.798335 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-37de3ebe-fa26-4d76-8778-3bb550d1eba7 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/9e92df8f-eeb3-4094-87c6-33843f3bcb13" status: 404 len: 109 microversion: 2.1 time: 0.099916 Jul 28 03:37:13.798741 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 13/14] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Jul 28 03:37:13 2021] DELETE /compute/v2.1/os-volumes/9e92df8f-eeb3-4094-87c6-33843f3bcb13 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:13.810303 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b5b9acc8-4778-415a-a664-3250417be3a6 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Calling method '.version_select at 0x7f6807db7dc0>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:13.861948 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-b5b9acc8-4778-415a-a664-3250417be3a6 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] HTTP exception thrown: Volume f367df5b-1fc3-427d-9062-af05f7c6d86d could not be found. Jul 28 03:37:13.862835 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b5b9acc8-4778-415a-a664-3250417be3a6 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] Returning 404 to user: Volume f367df5b-1fc3-427d-9062-af05f7c6d86d could not be found. {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:37:13.864072 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b5b9acc8-4778-415a-a664-3250417be3a6 tempest-VolumesNegativeTest-1997758913 tempest-VolumesNegativeTest-1997758913-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f367df5b-1fc3-427d-9062-af05f7c6d86d" status: 404 len: 109 microversion: 2.1 time: 0.058208 Jul 28 03:37:13.864769 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 14/15] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Jul 28 03:37:13 2021] GET /compute/v2.1/os-volumes/f367df5b-1fc3-427d-9062-af05f7c6d86d => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:14.108214 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-09983ed0-88e5-44af-a148-f19c26bf1a82 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:14.109825 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-09983ed0-88e5-44af-a148-f19c26bf1a82 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:14.293970 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-09983ed0-88e5-44af-a148-f19c26bf1a82 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:14.300802 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-09983ed0-88e5-44af-a148-f19c26bf1a82 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1214 microversion: 2.1 time: 0.198114 Jul 28 03:37:14.302625 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 15/16] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:14 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:14.677831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:14.680013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:14.681524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:14.687041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:14.688818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:14.692397 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-65e58d33-2e9c-4ba9-8e6a-3e6a9d776c33 tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] Calling method '.version_select at 0x7f6807db79d0>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:14.725756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:14.726525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:14.727552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:14.728472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:14.741536 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-65e58d33-2e9c-4ba9-8e6a-3e6a9d776c33 tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] HTTP exception thrown: Volume 39a5e3a5-68fa-4f94-bc1f-3667892ea882 could not be found. Jul 28 03:37:14.742129 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-65e58d33-2e9c-4ba9-8e6a-3e6a9d776c33 tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] Returning 404 to user: Volume 39a5e3a5-68fa-4f94-bc1f-3667892ea882 could not be found. {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:37:14.743010 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-65e58d33-2e9c-4ba9-8e6a-3e6a9d776c33 tempest-VolumesGetTestJSON-209622417 tempest-VolumesGetTestJSON-209622417-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/39a5e3a5-68fa-4f94-bc1f-3667892ea882" status: 404 len: 109 microversion: 2.1 time: 0.054940 Jul 28 03:37:14.746676 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 16/17] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Jul 28 03:37:14 2021] GET /compute/v2.1/os-volumes/39a5e3a5-68fa-4f94-bc1f-3667892ea882 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:14.789079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Getting quotas for project da239fd2931445e6be6459a0225fbd85. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:37:14.799315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Getting quotas for user f3ecf43d42c74783a82bf45afd8826e8 and project da239fd2931445e6be6459a0225fbd85. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:37:14.820889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:37:14.825494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:37:14.977315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c25fc443-e735-471d-b842-a64a2c39d81f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.478469 Jul 28 03:37:14.978023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 2/18] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:37:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 3480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:37:14.988384 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b5dc85be-bc4a-429f-8af6-7dad9381fb91 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:14.989636 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b5dc85be-bc4a-429f-8af6-7dad9381fb91 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:15.166114 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b5dc85be-bc4a-429f-8af6-7dad9381fb91 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:15.173278 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b5dc85be-bc4a-429f-8af6-7dad9381fb91 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1217 microversion: 2.1 time: 0.188830 Jul 28 03:37:15.174816 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 17/19] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:14 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:15.319356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dffc32ed-d16f-4e28-84f4-56aa8096b2b1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:15.320217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dffc32ed-d16f-4e28-84f4-56aa8096b2b1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:15.360655 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dffc32ed-d16f-4e28-84f4-56aa8096b2b1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:15.363163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dffc32ed-d16f-4e28-84f4-56aa8096b2b1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:15.364291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dffc32ed-d16f-4e28-84f4-56aa8096b2b1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:15.365916 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dffc32ed-d16f-4e28-84f4-56aa8096b2b1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:15.703979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dffc32ed-d16f-4e28-84f4-56aa8096b2b1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:15.744873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dffc32ed-d16f-4e28-84f4-56aa8096b2b1 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1266 microversion: 2.1 time: 0.409342 Jul 28 03:37:15.755563 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 3/20] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:15 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1266 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:16.191535 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-84d9c07c-4457-46d3-9344-7b5f3f174ee8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:16.192890 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-84d9c07c-4457-46d3-9344-7b5f3f174ee8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:16.662014 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-84d9c07c-4457-46d3-9344-7b5f3f174ee8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:16.672609 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-84d9c07c-4457-46d3-9344-7b5f3f174ee8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1217 microversion: 2.1 time: 0.482863 Jul 28 03:37:16.683601 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 18/21] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:16 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1217 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:16.765024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-81d9f6a2-5fc5-4bae-9ef6-6034eae6663b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:16.765710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-81d9f6a2-5fc5-4bae-9ef6-6034eae6663b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:16.776536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81d9f6a2-5fc5-4bae-9ef6-6034eae6663b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:16.777195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81d9f6a2-5fc5-4bae-9ef6-6034eae6663b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:16.785111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81d9f6a2-5fc5-4bae-9ef6-6034eae6663b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:16.788714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81d9f6a2-5fc5-4bae-9ef6-6034eae6663b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:17.024202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-81d9f6a2-5fc5-4bae-9ef6-6034eae6663b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:17.035378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-81d9f6a2-5fc5-4bae-9ef6-6034eae6663b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1272 microversion: 2.1 time: 0.275742 Jul 28 03:37:17.046042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 4/22] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:16 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:17.690053 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ae7e4f80-172b-4d22-abc8-efc035347796 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:17.690867 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ae7e4f80-172b-4d22-abc8-efc035347796 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:17.707856 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ae7e4f80-172b-4d22-abc8-efc035347796 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:17.708457 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ae7e4f80-172b-4d22-abc8-efc035347796 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:17.709475 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ae7e4f80-172b-4d22-abc8-efc035347796 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:17.710016 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ae7e4f80-172b-4d22-abc8-efc035347796 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:18.063074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dc841029-e67a-4647-b39d-c843993f2293 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:18.065489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dc841029-e67a-4647-b39d-c843993f2293 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:18.079733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dc841029-e67a-4647-b39d-c843993f2293 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:18.083059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dc841029-e67a-4647-b39d-c843993f2293 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:18.085641 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dc841029-e67a-4647-b39d-c843993f2293 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:18.090614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dc841029-e67a-4647-b39d-c843993f2293 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:18.300959 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ae7e4f80-172b-4d22-abc8-efc035347796 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:18.329526 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ae7e4f80-172b-4d22-abc8-efc035347796 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1275 microversion: 2.1 time: 0.636723 Jul 28 03:37:18.346907 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 19/23] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:17 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1275 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:18.485306 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dc841029-e67a-4647-b39d-c843993f2293 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:18.492904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dc841029-e67a-4647-b39d-c843993f2293 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1272 microversion: 2.1 time: 0.434299 Jul 28 03:37:18.498399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 5/24] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:18 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1272 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:19.350843 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-723b19de-66f3-4414-b620-a0ace64e5655 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:19.354429 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-723b19de-66f3-4414-b620-a0ace64e5655 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:19.370698 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-723b19de-66f3-4414-b620-a0ace64e5655 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:19.376489 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-723b19de-66f3-4414-b620-a0ace64e5655 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:19.377504 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-723b19de-66f3-4414-b620-a0ace64e5655 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:19.381135 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-723b19de-66f3-4414-b620-a0ace64e5655 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:19.512969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fea89511-13a6-40bd-8c3d-34dc1b533f11 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:19.514204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fea89511-13a6-40bd-8c3d-34dc1b533f11 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:19.524309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fea89511-13a6-40bd-8c3d-34dc1b533f11 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:19.525249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fea89511-13a6-40bd-8c3d-34dc1b533f11 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:19.526302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fea89511-13a6-40bd-8c3d-34dc1b533f11 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:19.582768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fea89511-13a6-40bd-8c3d-34dc1b533f11 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:19.961429 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-723b19de-66f3-4414-b620-a0ace64e5655 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:19.977965 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-723b19de-66f3-4414-b620-a0ace64e5655 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1275 microversion: 2.1 time: 0.630913 Jul 28 03:37:19.989761 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 20/25] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:19 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1275 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:20.998299 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7c4f0760-65d5-4fb4-8e66-10916442e2b6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:20.999919 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-7c4f0760-65d5-4fb4-8e66-10916442e2b6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:21.022521 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7c4f0760-65d5-4fb4-8e66-10916442e2b6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:21.025773 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7c4f0760-65d5-4fb4-8e66-10916442e2b6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:21.026969 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7c4f0760-65d5-4fb4-8e66-10916442e2b6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:21.033700 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7c4f0760-65d5-4fb4-8e66-10916442e2b6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:21.304934 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-7c4f0760-65d5-4fb4-8e66-10916442e2b6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:21.352354 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-7c4f0760-65d5-4fb4-8e66-10916442e2b6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1275 microversion: 2.1 time: 0.358526 Jul 28 03:37:21.368763 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 21/26] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:20 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1275 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:21.611147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fea89511-13a6-40bd-8c3d-34dc1b533f11 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:21.623107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fea89511-13a6-40bd-8c3d-34dc1b533f11 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 2.114041 Jul 28 03:37:21.632992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 6/27] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:19 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:22.390857 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c434ec7d-8975-408e-8ec8-f0e49464ae26 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:22.392215 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c434ec7d-8975-408e-8ec8-f0e49464ae26 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:22.400733 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c434ec7d-8975-408e-8ec8-f0e49464ae26 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:22.404822 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c434ec7d-8975-408e-8ec8-f0e49464ae26 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:22.406004 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c434ec7d-8975-408e-8ec8-f0e49464ae26 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:22.407791 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c434ec7d-8975-408e-8ec8-f0e49464ae26 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:22.640339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-93d6d1ea-3f83-45b2-a5cd-b359866beb4b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:22.642488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-93d6d1ea-3f83-45b2-a5cd-b359866beb4b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:22.662382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93d6d1ea-3f83-45b2-a5cd-b359866beb4b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:22.663325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93d6d1ea-3f83-45b2-a5cd-b359866beb4b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:22.664576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93d6d1ea-3f83-45b2-a5cd-b359866beb4b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:22.665633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93d6d1ea-3f83-45b2-a5cd-b359866beb4b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:23.423112 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-93d6d1ea-3f83-45b2-a5cd-b359866beb4b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:23.432891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-93d6d1ea-3f83-45b2-a5cd-b359866beb4b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.796195 Jul 28 03:37:23.434604 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 7/28] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:22 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:23.910938 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c434ec7d-8975-408e-8ec8-f0e49464ae26 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:23.931926 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c434ec7d-8975-408e-8ec8-f0e49464ae26 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1275 microversion: 2.1 time: 1.540320 Jul 28 03:37:23.933105 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 22/29] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:22 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1275 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:24.451801 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-783f4c60-3e2d-4621-9ddb-1d2f92b253b9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.452610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-783f4c60-3e2d-4621-9ddb-1d2f92b253b9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:24.470664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-783f4c60-3e2d-4621-9ddb-1d2f92b253b9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:24.471222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-783f4c60-3e2d-4621-9ddb-1d2f92b253b9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:24.472082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-783f4c60-3e2d-4621-9ddb-1d2f92b253b9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:24.472574 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-783f4c60-3e2d-4621-9ddb-1d2f92b253b9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:24.959464 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f6d285ab-6114-42b6-888f-b975a2de985b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.964285 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f6d285ab-6114-42b6-888f-b975a2de985b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:24.994034 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f6d285ab-6114-42b6-888f-b975a2de985b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:24.994465 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f6d285ab-6114-42b6-888f-b975a2de985b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:24.995312 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f6d285ab-6114-42b6-888f-b975a2de985b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:24.997798 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f6d285ab-6114-42b6-888f-b975a2de985b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:25.685372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-783f4c60-3e2d-4621-9ddb-1d2f92b253b9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:25.733568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-783f4c60-3e2d-4621-9ddb-1d2f92b253b9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 1.258175 Jul 28 03:37:25.733568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 8/30] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:24 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:25.902557 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f6d285ab-6114-42b6-888f-b975a2de985b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:25.937908 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f6d285ab-6114-42b6-888f-b975a2de985b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.985483 Jul 28 03:37:25.951293 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 23/31] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:24 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:26.737644 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fbd899f4-da84-4af6-a810-29defaa0512a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:26.738340 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-fbd899f4-da84-4af6-a810-29defaa0512a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:26.765300 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fbd899f4-da84-4af6-a810-29defaa0512a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:26.769523 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fbd899f4-da84-4af6-a810-29defaa0512a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:26.773973 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fbd899f4-da84-4af6-a810-29defaa0512a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:26.776128 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fbd899f4-da84-4af6-a810-29defaa0512a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:27.150556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cdd02d9d-afb4-44db-998f-ad02d6fe880f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'create', calling method: .version_select at 0x7f6807cf49d0>, body: {"keypair": {"name": "tempest-keypair-889918020"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:27.269354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-cdd02d9d-afb4-44db-998f-ad02d6fe880f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:37:27.290127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-cdd02d9d-afb4-44db-998f-ad02d6fe880f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for user faf7da464d4c44db918dd6c5076846e9 and project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:37:27.791689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-cdd02d9d-afb4-44db-998f-ad02d6fe880f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:37:27.796281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-cdd02d9d-afb4-44db-998f-ad02d6fe880f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for user faf7da464d4c44db918dd6c5076846e9 and project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:37:27.833727 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cdd02d9d-afb4-44db-998f-ad02d6fe880f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.574771 Jul 28 03:37:27.835565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 9/32] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jul 28 03:37:26 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:27.847000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c8d5ce62-b8f7-42bb-8516-ebc111ccb9c3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:27.850802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c8d5ce62-b8f7-42bb-8516-ebc111ccb9c3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:27.859283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c8d5ce62-b8f7-42bb-8516-ebc111ccb9c3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:27.860125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c8d5ce62-b8f7-42bb-8516-ebc111ccb9c3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:27.861202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c8d5ce62-b8f7-42bb-8516-ebc111ccb9c3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:27.861863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c8d5ce62-b8f7-42bb-8516-ebc111ccb9c3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:28.015247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-fbd899f4-da84-4af6-a810-29defaa0512a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:28.023265 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-fbd899f4-da84-4af6-a810-29defaa0512a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 1.294486 Jul 28 03:37:28.032003 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 24/33] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:26 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:28.334112 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-543f71b9-f9e9-44ad-8739-9138df3dbfeb req-4615dc8b-8727-40e0-b4aa-cec803c68010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0275d16a-5dbd-4afc-a597-75061e247ec7", "tag": "b3e3ec1a-8dd4-4c1a-a32d-07e3daad5d64"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:28.336892 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:28.336892 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:37:28.366254 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-543f71b9-f9e9-44ad-8739-9138df3dbfeb req-4615dc8b-8727-40e0-b4aa-cec803c68010 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:28.366745 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-543f71b9-f9e9-44ad-8739-9138df3dbfeb req-4615dc8b-8727-40e0-b4aa-cec803c68010 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:28.410497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c8d5ce62-b8f7-42bb-8516-ebc111ccb9c3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:28.424416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c8d5ce62-b8f7-42bb-8516-ebc111ccb9c3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.584502 Jul 28 03:37:28.431115 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-543f71b9-f9e9-44ad-8739-9138df3dbfeb req-4615dc8b-8727-40e0-b4aa-cec803c68010 service nova] Creating event network-changed:b3e3ec1a-8dd4-4c1a-a32d-07e3daad5d64 for instance 0275d16a-5dbd-4afc-a597-75061e247ec7 on hv-cinder-73306 Jul 28 03:37:28.431658 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-543f71b9-f9e9-44ad-8739-9138df3dbfeb req-4615dc8b-8727-40e0-b4aa-cec803c68010 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119155) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 28 03:37:28.435276 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c3e9dedb-35be-4d6a-a092-df22d6755e21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:28.435749 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c3e9dedb-35be-4d6a-a092-df22d6755e21 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:28.436559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c3e9dedb-35be-4d6a-a092-df22d6755e21 None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:28.436994 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c3e9dedb-35be-4d6a-a092-df22d6755e21 None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:28.437921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 10/34] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:27 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:28.465161 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.compute.rpcapi [None req-c3e9dedb-35be-4d6a-a092-df22d6755e21 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 28 03:37:28.466387 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c3e9dedb-35be-4d6a-a092-df22d6755e21 None None] Releasing lock "compute-rpcapi-router" {{(pid=119155) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 28 03:37:28.576229 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c3e9dedb-35be-4d6a-a092-df22d6755e21 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.536877 Jul 28 03:37:28.580109 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 25/35] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:37:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:29.047401 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7c7a1584-eb05-410b-8ed6-b4c162dfd7fe tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:29.048078 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-7c7a1584-eb05-410b-8ed6-b4c162dfd7fe tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:29.066480 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7c7a1584-eb05-410b-8ed6-b4c162dfd7fe tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:29.067958 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7c7a1584-eb05-410b-8ed6-b4c162dfd7fe tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:29.070883 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7c7a1584-eb05-410b-8ed6-b4c162dfd7fe tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:29.072965 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7c7a1584-eb05-410b-8ed6-b4c162dfd7fe tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:29.426540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9df31cf4-a485-4dd4-ad3e-7655d2740737 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'create', calling method: .version_select at 0x7f6807d1f8b0>, body: {"keypair": {"name": "tempest-keypair-1791184133"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:29.470261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-9df31cf4-a485-4dd4-ad3e-7655d2740737 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:37:29.483302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-9df31cf4-a485-4dd4-ad3e-7655d2740737 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for user fd82b48aabbb419cb891867d0b1a57e0 and project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:37:29.884346 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-7c7a1584-eb05-410b-8ed6-b4c162dfd7fe tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:29.924265 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-7c7a1584-eb05-410b-8ed6-b4c162dfd7fe tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.881662 Jul 28 03:37:29.934717 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 26/36] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:29 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:29.976065 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7dff05b0-0b51-47ac-bdaa-700d19eee142 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:29.982325 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-7dff05b0-0b51-47ac-bdaa-700d19eee142 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:30.012227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-9df31cf4-a485-4dd4-ad3e-7655d2740737 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:37:30.014215 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7dff05b0-0b51-47ac-bdaa-700d19eee142 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:30.014897 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7dff05b0-0b51-47ac-bdaa-700d19eee142 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:30.017179 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7dff05b0-0b51-47ac-bdaa-700d19eee142 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:30.022581 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7dff05b0-0b51-47ac-bdaa-700d19eee142 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:30.049071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-9df31cf4-a485-4dd4-ad3e-7655d2740737 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for user fd82b48aabbb419cb891867d0b1a57e0 and project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:37:30.091622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9df31cf4-a485-4dd4-ad3e-7655d2740737 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.229632 Jul 28 03:37:30.100471 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 11/37] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Jul 28 03:37:28 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1239 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:37:30.533827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-5ee037e6-d988-40ea-bbbc-223caa2624b9 req-ff461868-96c4-46f1-8c95-2a0985d248c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b227749a-44c6-4ab6-8c93-95345fba06ba", "tag": "77bcf32c-4248-435a-be8b-cbf0a47caa64"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:30.539074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:30.539074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:37:30.587993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5ee037e6-d988-40ea-bbbc-223caa2624b9 req-ff461868-96c4-46f1-8c95-2a0985d248c2 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:30.591560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5ee037e6-d988-40ea-bbbc-223caa2624b9 req-ff461868-96c4-46f1-8c95-2a0985d248c2 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:30.634470 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-7dff05b0-0b51-47ac-bdaa-700d19eee142 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:30.645035 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-7dff05b0-0b51-47ac-bdaa-700d19eee142 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.708936 Jul 28 03:37:30.648534 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 27/38] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:29 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:30.696737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-5ee037e6-d988-40ea-bbbc-223caa2624b9 req-ff461868-96c4-46f1-8c95-2a0985d248c2 service nova] Creating event network-changed:77bcf32c-4248-435a-be8b-cbf0a47caa64 for instance b227749a-44c6-4ab6-8c93-95345fba06ba on hv-cinder-73306 Jul 28 03:37:30.699488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5ee037e6-d988-40ea-bbbc-223caa2624b9 req-ff461868-96c4-46f1-8c95-2a0985d248c2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119154) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 28 03:37:30.706231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f5b56eb-68c4-46ee-a2af-f8cb1395e5d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:30.708950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f5b56eb-68c4-46ee-a2af-f8cb1395e5d3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:30.713393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f5b56eb-68c4-46ee-a2af-f8cb1395e5d3 None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:30.714494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f5b56eb-68c4-46ee-a2af-f8cb1395e5d3 None None] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:30.756844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.compute.rpcapi [None req-0f5b56eb-68c4-46ee-a2af-f8cb1395e5d3 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 28 03:37:30.758671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f5b56eb-68c4-46ee-a2af-f8cb1395e5d3 None None] Releasing lock "compute-rpcapi-router" {{(pid=119154) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 28 03:37:30.866796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0f5b56eb-68c4-46ee-a2af-f8cb1395e5d3 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.764710 Jul 28 03:37:30.867643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 12/39] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:37:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:30.946284 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-053614b2-aac1-4b87-866c-25bc7fc003b4 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:30.947345 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-053614b2-aac1-4b87-866c-25bc7fc003b4 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:30.961201 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-053614b2-aac1-4b87-866c-25bc7fc003b4 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:30.967640 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-053614b2-aac1-4b87-866c-25bc7fc003b4 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:30.968729 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-053614b2-aac1-4b87-866c-25bc7fc003b4 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:30.971459 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-053614b2-aac1-4b87-866c-25bc7fc003b4 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:31.667686 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-053614b2-aac1-4b87-866c-25bc7fc003b4 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:31.673980 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1111b2ac-3041-444b-b809-23c347665cd7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:31.678688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1111b2ac-3041-444b-b809-23c347665cd7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:31.694605 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-053614b2-aac1-4b87-866c-25bc7fc003b4 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.747490 Jul 28 03:37:31.709189 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 28/40] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:30 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:31.710490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1111b2ac-3041-444b-b809-23c347665cd7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:31.710952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1111b2ac-3041-444b-b809-23c347665cd7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:31.717495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1111b2ac-3041-444b-b809-23c347665cd7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:31.718221 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1111b2ac-3041-444b-b809-23c347665cd7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:32.253095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1111b2ac-3041-444b-b809-23c347665cd7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:32.268941 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1111b2ac-3041-444b-b809-23c347665cd7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.603314 Jul 28 03:37:32.273987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 13/41] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:31 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:32.712496 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a948540b-99ae-42ca-b897-b2f12300835e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:32.713111 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a948540b-99ae-42ca-b897-b2f12300835e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:32.723605 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a948540b-99ae-42ca-b897-b2f12300835e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:32.724453 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a948540b-99ae-42ca-b897-b2f12300835e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:32.725398 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a948540b-99ae-42ca-b897-b2f12300835e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:32.727560 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a948540b-99ae-42ca-b897-b2f12300835e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:33.114878 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a948540b-99ae-42ca-b897-b2f12300835e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:33.123616 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a948540b-99ae-42ca-b897-b2f12300835e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.414688 Jul 28 03:37:33.138022 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 29/42] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:32 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:33.289963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9d6269d8-5315-4113-926f-c396a1d2fcfd tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:33.291132 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9d6269d8-5315-4113-926f-c396a1d2fcfd tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:33.302585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9d6269d8-5315-4113-926f-c396a1d2fcfd tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:33.303055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9d6269d8-5315-4113-926f-c396a1d2fcfd tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:33.306439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9d6269d8-5315-4113-926f-c396a1d2fcfd tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:33.306920 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9d6269d8-5315-4113-926f-c396a1d2fcfd tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:33.525865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9d6269d8-5315-4113-926f-c396a1d2fcfd tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:33.547685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9d6269d8-5315-4113-926f-c396a1d2fcfd tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.257244 Jul 28 03:37:33.547685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 14/43] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:33 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:34.143480 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-196e548f-eebf-4396-a9c1-d0306cd6b72d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:34.144685 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-196e548f-eebf-4396-a9c1-d0306cd6b72d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:34.153975 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-196e548f-eebf-4396-a9c1-d0306cd6b72d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:34.156591 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-196e548f-eebf-4396-a9c1-d0306cd6b72d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:34.160037 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-196e548f-eebf-4396-a9c1-d0306cd6b72d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:34.161261 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-196e548f-eebf-4396-a9c1-d0306cd6b72d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:34.569922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3cad093c-2158-485c-ab1e-561aeb4d5921 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:34.571195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3cad093c-2158-485c-ab1e-561aeb4d5921 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:34.593354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3cad093c-2158-485c-ab1e-561aeb4d5921 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:34.594469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3cad093c-2158-485c-ab1e-561aeb4d5921 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:34.595679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3cad093c-2158-485c-ab1e-561aeb4d5921 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:34.600724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3cad093c-2158-485c-ab1e-561aeb4d5921 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:34.755636 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-196e548f-eebf-4396-a9c1-d0306cd6b72d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:34.767843 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-196e548f-eebf-4396-a9c1-d0306cd6b72d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.629037 Jul 28 03:37:34.771445 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 30/44] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:34 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:34.779954 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1584829726", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09233d9b-0c94-4f1f-a3bd-45f2d97443e5"}], "security_groups": [{"name": "tempest-securitygroup--2245124"}], "key_name": "tempest-keypair-1791184133", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:34.827538 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3cad093c-2158-485c-ab1e-561aeb4d5921 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:34.838879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3cad093c-2158-485c-ab1e-561aeb4d5921 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.277996 Jul 28 03:37:34.841247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 15/45] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:34 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:34.962134 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.network.neutron [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] validate_networks() for [('09233d9b-0c94-4f1f-a3bd-45f2d97443e5', None, None, None)] {{(pid=119155) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:37:35.315699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1923788239", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4735ad5f-8ca5-4c8f-80b1-984a4e72f7a0"}], "security_groups": [{"name": "tempest-securitygroup--1602539106"}], "key_name": "tempest-keypair-889918020", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:35.568703 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] validate_networks() for [('4735ad5f-8ca5-4c8f-80b1-984a4e72f7a0', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:37:35.685868 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Flavor limits 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:35.686306 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Image limits 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:35.686761 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Flavor pref 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:35.687172 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Image pref 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:35.687647 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:35.698080 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:35.698595 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:35.700115 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:35.700696 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:35.722771 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.quota [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'ram', 'cores', 'instances'} {{(pid=119155) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:37:35.727348 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.quota [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for user fd82b48aabbb419cb891867d0b1a57e0 and project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'ram', 'cores', 'instances'} {{(pid=119155) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:37:35.740823 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Going to run 1 instances... {{(pid=119155) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:37:35.744091 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119155) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:37:35.819654 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-798a953a-e093-47e3-a14a-5539df168ffd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.047020 Jul 28 03:37:35.827565 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 31/46] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Jul 28 03:37:34 2021] POST /compute/v2.1/servers => generated 399 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:37:35.834666 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f85085fb-9b61-4906-a98c-9d66d306121a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:35.834666 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f85085fb-9b61-4906-a98c-9d66d306121a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:35.857710 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f85085fb-9b61-4906-a98c-9d66d306121a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:35.858437 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f85085fb-9b61-4906-a98c-9d66d306121a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:35.859946 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f85085fb-9b61-4906-a98c-9d66d306121a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:35.860572 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f85085fb-9b61-4906-a98c-9d66d306121a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:36.388291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:36.389407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:36.391026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:36.391659 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:36.393445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:36.416112 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:36.416921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:36.420482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:36.421578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:36.432834 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f85085fb-9b61-4906-a98c-9d66d306121a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.444671 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f85085fb-9b61-4906-a98c-9d66d306121a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.615589 Jul 28 03:37:36.445477 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 32/47] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:35 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:36.451608 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-85abe505-91d7-4739-ba22-e7297efed5dd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:36.452355 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-85abe505-91d7-4739-ba22-e7297efed5dd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:36.490203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:37:36.503066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for user faf7da464d4c44db918dd6c5076846e9 and project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:37:36.545294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:37:36.557389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:37:36.614295 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-85abe505-91d7-4739-ba22-e7297efed5dd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.629491 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-85abe505-91d7-4739-ba22-e7297efed5dd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.633127 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-85abe505-91d7-4739-ba22-e7297efed5dd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.641028 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-85abe505-91d7-4739-ba22-e7297efed5dd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1282 microversion: 2.20 time: 0.188191 Jul 28 03:37:36.644277 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 33/48] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:36 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:36.680085 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2f45fb20-e8aa-4ea5-8340-043641d00113 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:36.682114 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2f45fb20-e8aa-4ea5-8340-043641d00113 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:36.717694 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2f45fb20-e8aa-4ea5-8340-043641d00113 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:36.718226 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2f45fb20-e8aa-4ea5-8340-043641d00113 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:36.719222 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2f45fb20-e8aa-4ea5-8340-043641d00113 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:36.721970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fc1acb54-869c-43c9-a719-62fe389643ea tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.409814 Jul 28 03:37:36.723635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 16/49] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:37:35 2021] POST /compute/v2.1/servers => generated 402 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:37:36.724133 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2f45fb20-e8aa-4ea5-8340-043641d00113 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:36.747455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f062ff34-e73c-4dee-bd0b-c9f005bdac3e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:36.748390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f062ff34-e73c-4dee-bd0b-c9f005bdac3e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:36.859550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f062ff34-e73c-4dee-bd0b-c9f005bdac3e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.874109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f062ff34-e73c-4dee-bd0b-c9f005bdac3e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1237 microversion: 2.1 time: 0.144363 Jul 28 03:37:36.877233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 17/50] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:36 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:37.109861 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-2f45fb20-e8aa-4ea5-8340-043641d00113 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.129132 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2f45fb20-e8aa-4ea5-8340-043641d00113 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.482835 Jul 28 03:37:37.131865 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 34/51] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:36 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:37.467126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ac639991-a128-477f-b322-61e1c99795df tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:37.467863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ac639991-a128-477f-b322-61e1c99795df tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:37.476468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac639991-a128-477f-b322-61e1c99795df tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:37.476941 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac639991-a128-477f-b322-61e1c99795df tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:37.478026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac639991-a128-477f-b322-61e1c99795df tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:37.478772 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac639991-a128-477f-b322-61e1c99795df tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:37.665004 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-44c4e5e7-cff1-485b-86cc-15853900c98e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:37.665774 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-44c4e5e7-cff1-485b-86cc-15853900c98e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:37.674015 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-44c4e5e7-cff1-485b-86cc-15853900c98e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:37.679170 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-44c4e5e7-cff1-485b-86cc-15853900c98e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:37.680353 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-44c4e5e7-cff1-485b-86cc-15853900c98e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:37.682874 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-44c4e5e7-cff1-485b-86cc-15853900c98e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:37.695948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ac639991-a128-477f-b322-61e1c99795df tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.705400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ac639991-a128-477f-b322-61e1c99795df tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.248507 Jul 28 03:37:37.705975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 18/52] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:37 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:37.856625 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-44c4e5e7-cff1-485b-86cc-15853900c98e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.872836 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-44c4e5e7-cff1-485b-86cc-15853900c98e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.874922 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-44c4e5e7-cff1-485b-86cc-15853900c98e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.886610 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-44c4e5e7-cff1-485b-86cc-15853900c98e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1342 microversion: 2.20 time: 0.224156 Jul 28 03:37:37.887736 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 35/53] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:37 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:37.904586 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-908deda8-a236-4f70-96c7-80bda6760fc6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:37.905765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-908deda8-a236-4f70-96c7-80bda6760fc6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:37.916266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-908deda8-a236-4f70-96c7-80bda6760fc6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:37.916954 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-908deda8-a236-4f70-96c7-80bda6760fc6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:37.919669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-908deda8-a236-4f70-96c7-80bda6760fc6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:37.921215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-908deda8-a236-4f70-96c7-80bda6760fc6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:38.048751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-908deda8-a236-4f70-96c7-80bda6760fc6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:38.059145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-908deda8-a236-4f70-96c7-80bda6760fc6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1289 microversion: 2.1 time: 0.157412 Jul 28 03:37:38.061902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 19/54] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:37 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1289 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:38.149264 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b2ede9ed-7fbf-4a7f-9c3c-4203f35d4e47 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:38.149894 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b2ede9ed-7fbf-4a7f-9c3c-4203f35d4e47 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:38.160531 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b2ede9ed-7fbf-4a7f-9c3c-4203f35d4e47 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:38.162845 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b2ede9ed-7fbf-4a7f-9c3c-4203f35d4e47 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:38.170208 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b2ede9ed-7fbf-4a7f-9c3c-4203f35d4e47 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:38.173283 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b2ede9ed-7fbf-4a7f-9c3c-4203f35d4e47 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:38.547671 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b2ede9ed-7fbf-4a7f-9c3c-4203f35d4e47 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:38.555180 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b2ede9ed-7fbf-4a7f-9c3c-4203f35d4e47 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.410664 Jul 28 03:37:38.555917 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 36/55] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:38 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:38.723761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a4c31d56-f038-4c1e-9ade-1ced9bbfefaf tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:38.724368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a4c31d56-f038-4c1e-9ade-1ced9bbfefaf tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:38.736306 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4c31d56-f038-4c1e-9ade-1ced9bbfefaf tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:38.738721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4c31d56-f038-4c1e-9ade-1ced9bbfefaf tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:38.750083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4c31d56-f038-4c1e-9ade-1ced9bbfefaf tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:38.750762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4c31d56-f038-4c1e-9ade-1ced9bbfefaf tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:38.905826 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-27d91db3-0d31-4684-b362-f09cded4a129 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:38.906451 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-27d91db3-0d31-4684-b362-f09cded4a129 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:38.923276 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-27d91db3-0d31-4684-b362-f09cded4a129 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:38.923758 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-27d91db3-0d31-4684-b362-f09cded4a129 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:38.924550 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-27d91db3-0d31-4684-b362-f09cded4a129 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:38.925261 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-27d91db3-0d31-4684-b362-f09cded4a129 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:39.096071 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-27d91db3-0d31-4684-b362-f09cded4a129 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:39.107144 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-27d91db3-0d31-4684-b362-f09cded4a129 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:39.109569 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-27d91db3-0d31-4684-b362-f09cded4a129 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:39.111292 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-27d91db3-0d31-4684-b362-f09cded4a129 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1340 microversion: 2.20 time: 0.210348 Jul 28 03:37:39.112573 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 37/56] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:38 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1340 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:39.117644 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f99de55b-bc2b-4370-b9ad-45bdcdf66012 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:39.118492 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f99de55b-bc2b-4370-b9ad-45bdcdf66012 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:39.133768 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f99de55b-bc2b-4370-b9ad-45bdcdf66012 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:39.134845 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f99de55b-bc2b-4370-b9ad-45bdcdf66012 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:39.135541 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f99de55b-bc2b-4370-b9ad-45bdcdf66012 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:39.136712 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f99de55b-bc2b-4370-b9ad-45bdcdf66012 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:39.242089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4c31d56-f038-4c1e-9ade-1ced9bbfefaf tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:39.254627 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f99de55b-bc2b-4370-b9ad-45bdcdf66012 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:39.258383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a4c31d56-f038-4c1e-9ade-1ced9bbfefaf tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.539289 Jul 28 03:37:39.259285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 20/57] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:38 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:39.272862 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f99de55b-bc2b-4370-b9ad-45bdcdf66012 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1295 microversion: 2.1 time: 0.158642 Jul 28 03:37:39.282654 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 38/58] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:39 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1295 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:39.573793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-138f10d8-dae0-406c-8a41-01014b02a721 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:39.574865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-138f10d8-dae0-406c-8a41-01014b02a721 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:39.583869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-138f10d8-dae0-406c-8a41-01014b02a721 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:39.584529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-138f10d8-dae0-406c-8a41-01014b02a721 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:39.585699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-138f10d8-dae0-406c-8a41-01014b02a721 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:39.586570 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-138f10d8-dae0-406c-8a41-01014b02a721 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:39.994260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-138f10d8-dae0-406c-8a41-01014b02a721 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.009430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-138f10d8-dae0-406c-8a41-01014b02a721 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.439914 Jul 28 03:37:40.010012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 21/59] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:39 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:40.133987 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c55d27c6-e8ce-4b77-b306-d8c006985ada tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:40.134671 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c55d27c6-e8ce-4b77-b306-d8c006985ada tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:40.149605 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c55d27c6-e8ce-4b77-b306-d8c006985ada tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:40.150126 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c55d27c6-e8ce-4b77-b306-d8c006985ada tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:40.153041 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c55d27c6-e8ce-4b77-b306-d8c006985ada tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:40.153548 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c55d27c6-e8ce-4b77-b306-d8c006985ada tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:40.289628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6e568d8b-0f86-4cbc-8cf4-94f34850dc34 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:40.295622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6e568d8b-0f86-4cbc-8cf4-94f34850dc34 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:40.310611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e568d8b-0f86-4cbc-8cf4-94f34850dc34 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:40.311088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e568d8b-0f86-4cbc-8cf4-94f34850dc34 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:40.313840 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e568d8b-0f86-4cbc-8cf4-94f34850dc34 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:40.314321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e568d8b-0f86-4cbc-8cf4-94f34850dc34 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:40.723141 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c55d27c6-e8ce-4b77-b306-d8c006985ada tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.738865 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c55d27c6-e8ce-4b77-b306-d8c006985ada tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.743415 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c55d27c6-e8ce-4b77-b306-d8c006985ada tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.749319 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c55d27c6-e8ce-4b77-b306-d8c006985ada tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1405 microversion: 2.20 time: 0.621666 Jul 28 03:37:40.757214 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 39/60] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:40 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1405 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:40.773661 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0f5c9efc-2867-4360-867f-53835ef92570 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:40.774561 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0f5c9efc-2867-4360-867f-53835ef92570 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:40.801789 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f5c9efc-2867-4360-867f-53835ef92570 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:40.802276 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f5c9efc-2867-4360-867f-53835ef92570 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:40.803255 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f5c9efc-2867-4360-867f-53835ef92570 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:40.803695 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f5c9efc-2867-4360-867f-53835ef92570 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:41.319873 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0f5c9efc-2867-4360-867f-53835ef92570 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:41.330739 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0f5c9efc-2867-4360-867f-53835ef92570 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1363 microversion: 2.1 time: 0.569865 Jul 28 03:37:41.331371 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 40/61] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:40 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1363 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:41.381983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6e568d8b-0f86-4cbc-8cf4-94f34850dc34 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:41.396258 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6e568d8b-0f86-4cbc-8cf4-94f34850dc34 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 1.123099 Jul 28 03:37:41.398151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 22/62] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:40 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:41.410997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-968069ae-b0bb-4960-a347-f26277a4d6b0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:41.415862 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-968069ae-b0bb-4960-a347-f26277a4d6b0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:41.449442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-968069ae-b0bb-4960-a347-f26277a4d6b0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:41.450281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-968069ae-b0bb-4960-a347-f26277a4d6b0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:41.461762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-968069ae-b0bb-4960-a347-f26277a4d6b0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:41.463579 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-968069ae-b0bb-4960-a347-f26277a4d6b0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:41.588313 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-8a5b8c7e-83e9-456f-80b3-a3d0739e8b64 req-637dfa3e-cfec-417c-94ce-b7c57df7c952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b227749a-44c6-4ab6-8c93-95345fba06ba", "name": "network-vif-plugged", "status": "completed", "tag": "77bcf32c-4248-435a-be8b-cbf0a47caa64"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:41.590478 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:41.590478 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:37:41.601934 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-8a5b8c7e-83e9-456f-80b3-a3d0739e8b64 req-637dfa3e-cfec-417c-94ce-b7c57df7c952 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:41.602387 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-8a5b8c7e-83e9-456f-80b3-a3d0739e8b64 req-637dfa3e-cfec-417c-94ce-b7c57df7c952 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:41.622460 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-8a5b8c7e-83e9-456f-80b3-a3d0739e8b64 req-637dfa3e-cfec-417c-94ce-b7c57df7c952 service nova] Creating event network-vif-plugged:77bcf32c-4248-435a-be8b-cbf0a47caa64 for instance b227749a-44c6-4ab6-8c93-95345fba06ba on hv-cinder-73306 Jul 28 03:37:41.627978 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-8a5b8c7e-83e9-456f-80b3-a3d0739e8b64 req-637dfa3e-cfec-417c-94ce-b7c57df7c952 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293592 Jul 28 03:37:41.629209 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 41/63] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:37:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:41.636052 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-774d1759-b418-465e-8955-40158aef4cee req-d6c9a74b-b211-4c7e-8c1f-7b006397d808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622af242-a6fc-4f2d-9f03-61e88ee5e89f", "tag": "f743ec9f-b513-4bb3-b819-5c932959e75f"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:41.638538 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:41.638538 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:37:41.655227 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-774d1759-b418-465e-8955-40158aef4cee req-d6c9a74b-b211-4c7e-8c1f-7b006397d808 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:41.657985 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-774d1759-b418-465e-8955-40158aef4cee req-d6c9a74b-b211-4c7e-8c1f-7b006397d808 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:41.677001 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-774d1759-b418-465e-8955-40158aef4cee req-d6c9a74b-b211-4c7e-8c1f-7b006397d808 service nova] Creating event network-changed:f743ec9f-b513-4bb3-b819-5c932959e75f for instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f on hv-cinder-73306 Jul 28 03:37:41.697796 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-774d1759-b418-465e-8955-40158aef4cee req-d6c9a74b-b211-4c7e-8c1f-7b006397d808 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066831 Jul 28 03:37:41.699450 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 42/64] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:37:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:41.773566 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-25bb9cdf-21d4-42cf-a0fd-44949a5a4053 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:41.773993 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-25bb9cdf-21d4-42cf-a0fd-44949a5a4053 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:41.790118 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-25bb9cdf-21d4-42cf-a0fd-44949a5a4053 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:41.791608 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-25bb9cdf-21d4-42cf-a0fd-44949a5a4053 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:41.794622 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-25bb9cdf-21d4-42cf-a0fd-44949a5a4053 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:41.797183 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-25bb9cdf-21d4-42cf-a0fd-44949a5a4053 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:41.843144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-968069ae-b0bb-4960-a347-f26277a4d6b0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:41.860830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-968069ae-b0bb-4960-a347-f26277a4d6b0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.459051 Jul 28 03:37:41.861830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 23/65] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:41 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:42.141438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-f7913fc6-186f-489a-9ed5-24254a92ad2b req-9619caf9-b983-484f-a476-34904fe21e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0eb74a9-c89c-4863-9431-4de9be74c41c", "tag": "e78fba6c-176b-4f20-8246-8712019f721a"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:42.146691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:42.146691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:37:42.163369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-f7913fc6-186f-489a-9ed5-24254a92ad2b req-9619caf9-b983-484f-a476-34904fe21e71 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:42.166245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-f7913fc6-186f-489a-9ed5-24254a92ad2b req-9619caf9-b983-484f-a476-34904fe21e71 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:42.190172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-f7913fc6-186f-489a-9ed5-24254a92ad2b req-9619caf9-b983-484f-a476-34904fe21e71 service nova] Creating event network-changed:e78fba6c-176b-4f20-8246-8712019f721a for instance c0eb74a9-c89c-4863-9431-4de9be74c41c on hv-cinder-73306 Jul 28 03:37:42.210350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-f7913fc6-186f-489a-9ed5-24254a92ad2b req-9619caf9-b983-484f-a476-34904fe21e71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077357 Jul 28 03:37:42.211100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 24/66] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:37:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:42.281205 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-25bb9cdf-21d4-42cf-a0fd-44949a5a4053 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.290826 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-25bb9cdf-21d4-42cf-a0fd-44949a5a4053 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.292430 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-25bb9cdf-21d4-42cf-a0fd-44949a5a4053 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.294113 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-25bb9cdf-21d4-42cf-a0fd-44949a5a4053 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1405 microversion: 2.20 time: 0.525200 Jul 28 03:37:42.294242 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 43/67] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:41 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:42.350869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c3def544-847d-4a17-af18-837178d14534 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:42.351582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c3def544-847d-4a17-af18-837178d14534 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:42.365467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3def544-847d-4a17-af18-837178d14534 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:42.365938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3def544-847d-4a17-af18-837178d14534 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:42.369855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3def544-847d-4a17-af18-837178d14534 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:42.371977 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3def544-847d-4a17-af18-837178d14534 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:42.415961 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f77b262b-94bb-45b6-8b18-b2d07bef73bc tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:42.417044 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f77b262b-94bb-45b6-8b18-b2d07bef73bc tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:42.434775 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f77b262b-94bb-45b6-8b18-b2d07bef73bc tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:42.436381 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f77b262b-94bb-45b6-8b18-b2d07bef73bc tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:42.438851 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f77b262b-94bb-45b6-8b18-b2d07bef73bc tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:42.440469 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f77b262b-94bb-45b6-8b18-b2d07bef73bc tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:42.715780 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f77b262b-94bb-45b6-8b18-b2d07bef73bc tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.716147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c3def544-847d-4a17-af18-837178d14534 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.724507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c3def544-847d-4a17-af18-837178d14534 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1363 microversion: 2.1 time: 0.377967 Jul 28 03:37:42.725334 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f77b262b-94bb-45b6-8b18-b2d07bef73bc tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.314635 Jul 28 03:37:42.726156 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 25/68] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:42 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:42.732294 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 44/69] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:42 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:42.878357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2d9b1237-a1f6-4024-a208-d967ab6c854d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:42.879002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2d9b1237-a1f6-4024-a208-d967ab6c854d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:42.885048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2d9b1237-a1f6-4024-a208-d967ab6c854d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:42.885439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2d9b1237-a1f6-4024-a208-d967ab6c854d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:42.886218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2d9b1237-a1f6-4024-a208-d967ab6c854d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:42.887355 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2d9b1237-a1f6-4024-a208-d967ab6c854d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:43.129722 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2d9b1237-a1f6-4024-a208-d967ab6c854d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:43.145697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2d9b1237-a1f6-4024-a208-d967ab6c854d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.271005 Jul 28 03:37:43.146508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 26/70] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:42 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:43.311583 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8bc80553-4cef-4fd8-a630-884b8196c29a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:43.312804 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8bc80553-4cef-4fd8-a630-884b8196c29a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:43.321215 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8bc80553-4cef-4fd8-a630-884b8196c29a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:43.321869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8bc80553-4cef-4fd8-a630-884b8196c29a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:43.323054 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8bc80553-4cef-4fd8-a630-884b8196c29a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:43.323672 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8bc80553-4cef-4fd8-a630-884b8196c29a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:43.609154 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-8bc80553-4cef-4fd8-a630-884b8196c29a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:43.625647 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-8bc80553-4cef-4fd8-a630-884b8196c29a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:43.627140 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-8bc80553-4cef-4fd8-a630-884b8196c29a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:43.628307 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8bc80553-4cef-4fd8-a630-884b8196c29a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1405 microversion: 2.20 time: 0.321218 Jul 28 03:37:43.629095 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 45/71] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:43 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1405 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:43.648770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-4dd24c49-1570-4abc-a984-a74120183d89 req-92dae63f-fdf3-490f-b2ec-f10c8cc629ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0275d16a-5dbd-4afc-a597-75061e247ec7", "name": "network-vif-plugged", "status": "completed", "tag": "b3e3ec1a-8dd4-4c1a-a32d-07e3daad5d64"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:43.650676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:43.650676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:37:43.676535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-4dd24c49-1570-4abc-a984-a74120183d89 req-92dae63f-fdf3-490f-b2ec-f10c8cc629ed service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:43.678445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-4dd24c49-1570-4abc-a984-a74120183d89 req-92dae63f-fdf3-490f-b2ec-f10c8cc629ed service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:43.711537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-4dd24c49-1570-4abc-a984-a74120183d89 req-92dae63f-fdf3-490f-b2ec-f10c8cc629ed service nova] Creating event network-vif-plugged:b3e3ec1a-8dd4-4c1a-a32d-07e3daad5d64 for instance 0275d16a-5dbd-4afc-a597-75061e247ec7 on hv-cinder-73306 Jul 28 03:37:43.723034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-4dd24c49-1570-4abc-a984-a74120183d89 req-92dae63f-fdf3-490f-b2ec-f10c8cc629ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078073 Jul 28 03:37:43.725763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 27/72] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:37:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:43.751410 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-9de73149-9916-4141-ae03-dfab7da92ef6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:43.752149 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-9de73149-9916-4141-ae03-dfab7da92ef6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:43.754931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-00ff076d-b05b-4aac-af6b-401431d3fd97 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:43.756736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-00ff076d-b05b-4aac-af6b-401431d3fd97 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:43.765966 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9de73149-9916-4141-ae03-dfab7da92ef6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:43.768470 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-00ff076d-b05b-4aac-af6b-401431d3fd97 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:43.768614 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9de73149-9916-4141-ae03-dfab7da92ef6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:43.769205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-00ff076d-b05b-4aac-af6b-401431d3fd97 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:43.770196 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9de73149-9916-4141-ae03-dfab7da92ef6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:43.772951 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-00ff076d-b05b-4aac-af6b-401431d3fd97 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:43.773571 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9de73149-9916-4141-ae03-dfab7da92ef6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:43.774916 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-00ff076d-b05b-4aac-af6b-401431d3fd97 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:44.049023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-00ff076d-b05b-4aac-af6b-401431d3fd97 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:44.057411 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-9de73149-9916-4141-ae03-dfab7da92ef6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:44.060378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-00ff076d-b05b-4aac-af6b-401431d3fd97 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.309961 Jul 28 03:37:44.062163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 28/73] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:43 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:44.066485 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-9de73149-9916-4141-ae03-dfab7da92ef6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1363 microversion: 2.1 time: 0.327252 Jul 28 03:37:44.067058 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 46/74] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:43 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:44.163036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a6d65bd2-3a68-4bd8-a660-8ebd28573628 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:44.163858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a6d65bd2-3a68-4bd8-a660-8ebd28573628 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:44.170705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6d65bd2-3a68-4bd8-a660-8ebd28573628 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:44.171159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6d65bd2-3a68-4bd8-a660-8ebd28573628 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:44.171978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6d65bd2-3a68-4bd8-a660-8ebd28573628 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:44.172422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6d65bd2-3a68-4bd8-a660-8ebd28573628 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:44.304792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a6d65bd2-3a68-4bd8-a660-8ebd28573628 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:44.313485 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a6d65bd2-3a68-4bd8-a660-8ebd28573628 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1317 microversion: 2.1 time: 0.154212 Jul 28 03:37:44.314173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 29/75] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:44 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:44.646076 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d3437e53-8d50-4d77-b7e6-5c7eb8c77007 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:44.646623 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d3437e53-8d50-4d77-b7e6-5c7eb8c77007 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:44.652502 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d3437e53-8d50-4d77-b7e6-5c7eb8c77007 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:44.653025 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d3437e53-8d50-4d77-b7e6-5c7eb8c77007 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:44.653780 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d3437e53-8d50-4d77-b7e6-5c7eb8c77007 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:44.654209 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d3437e53-8d50-4d77-b7e6-5c7eb8c77007 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:44.788442 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d3437e53-8d50-4d77-b7e6-5c7eb8c77007 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:44.796774 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d3437e53-8d50-4d77-b7e6-5c7eb8c77007 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:44.798255 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d3437e53-8d50-4d77-b7e6-5c7eb8c77007 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:44.799324 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d3437e53-8d50-4d77-b7e6-5c7eb8c77007 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1405 microversion: 2.20 time: 0.156993 Jul 28 03:37:44.800192 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 47/76] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:44 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:45.084800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a787b22e-8e39-4ba5-9522-b653d239391a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:45.084800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a787b22e-8e39-4ba5-9522-b653d239391a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:45.090097 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a787b22e-8e39-4ba5-9522-b653d239391a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:45.090896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a787b22e-8e39-4ba5-9522-b653d239391a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:45.091605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a787b22e-8e39-4ba5-9522-b653d239391a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:45.092218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a787b22e-8e39-4ba5-9522-b653d239391a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:45.094507 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0f0b36c8-a94c-4d2a-a428-03cf43617136 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:45.095678 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0f0b36c8-a94c-4d2a-a428-03cf43617136 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:45.108770 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f0b36c8-a94c-4d2a-a428-03cf43617136 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:45.109566 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f0b36c8-a94c-4d2a-a428-03cf43617136 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:45.110357 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f0b36c8-a94c-4d2a-a428-03cf43617136 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:45.110982 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f0b36c8-a94c-4d2a-a428-03cf43617136 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:45.273859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a787b22e-8e39-4ba5-9522-b653d239391a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:45.282692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a787b22e-8e39-4ba5-9522-b653d239391a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1314 microversion: 2.1 time: 0.207430 Jul 28 03:37:45.283525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 30/77] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:45 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:45.291588 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0f0b36c8-a94c-4d2a-a428-03cf43617136 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:45.299919 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0f0b36c8-a94c-4d2a-a428-03cf43617136 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1363 microversion: 2.1 time: 0.211649 Jul 28 03:37:45.300957 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 48/78] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:45 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:45.332226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eb2db037-226b-411b-b0d5-2bce113e3d1b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:45.333081 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eb2db037-226b-411b-b0d5-2bce113e3d1b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:45.341416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb2db037-226b-411b-b0d5-2bce113e3d1b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:45.342247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb2db037-226b-411b-b0d5-2bce113e3d1b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:45.343199 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb2db037-226b-411b-b0d5-2bce113e3d1b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:45.343830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb2db037-226b-411b-b0d5-2bce113e3d1b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:45.499696 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eb2db037-226b-411b-b0d5-2bce113e3d1b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:45.512085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eb2db037-226b-411b-b0d5-2bce113e3d1b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1506 microversion: 2.1 time: 0.182029 Jul 28 03:37:45.513248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 31/79] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:45 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:45.818222 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5f4496ce-a7f2-4f5e-a32d-601ccb4801fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:45.819000 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5f4496ce-a7f2-4f5e-a32d-601ccb4801fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:45.827072 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f4496ce-a7f2-4f5e-a32d-601ccb4801fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:45.827814 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f4496ce-a7f2-4f5e-a32d-601ccb4801fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:45.828802 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f4496ce-a7f2-4f5e-a32d-601ccb4801fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:45.829566 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f4496ce-a7f2-4f5e-a32d-601ccb4801fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:45.972426 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5f4496ce-a7f2-4f5e-a32d-601ccb4801fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:45.981170 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5f4496ce-a7f2-4f5e-a32d-601ccb4801fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:45.982692 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5f4496ce-a7f2-4f5e-a32d-601ccb4801fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:45.983861 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5f4496ce-a7f2-4f5e-a32d-601ccb4801fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1405 microversion: 2.20 time: 0.169488 Jul 28 03:37:45.984831 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 49/80] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:45 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:46.298069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cbb77284-6f3d-4852-93be-40761219aa5f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:46.298687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cbb77284-6f3d-4852-93be-40761219aa5f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:46.304831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbb77284-6f3d-4852-93be-40761219aa5f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:46.305275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbb77284-6f3d-4852-93be-40761219aa5f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:46.306034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbb77284-6f3d-4852-93be-40761219aa5f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:46.306621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbb77284-6f3d-4852-93be-40761219aa5f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:46.317682 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-866bc0c8-19cc-4d96-9714-590e9bf4c11d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:46.318314 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-866bc0c8-19cc-4d96-9714-590e9bf4c11d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:46.329053 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-866bc0c8-19cc-4d96-9714-590e9bf4c11d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:46.329510 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-866bc0c8-19cc-4d96-9714-590e9bf4c11d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:46.330491 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-866bc0c8-19cc-4d96-9714-590e9bf4c11d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:46.330971 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-866bc0c8-19cc-4d96-9714-590e9bf4c11d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:46.467060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cbb77284-6f3d-4852-93be-40761219aa5f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:46.475058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cbb77284-6f3d-4852-93be-40761219aa5f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1501 microversion: 2.1 time: 0.180638 Jul 28 03:37:46.475962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 32/81] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:46 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:46.488689 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-866bc0c8-19cc-4d96-9714-590e9bf4c11d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:46.498207 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-866bc0c8-19cc-4d96-9714-590e9bf4c11d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1363 microversion: 2.1 time: 0.183959 Jul 28 03:37:46.507495 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 50/82] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:46 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:47.003761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0fd3c632-0174-4d08-8ec2-6cf89f85b057 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:47.004848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0fd3c632-0174-4d08-8ec2-6cf89f85b057 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:47.012440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fd3c632-0174-4d08-8ec2-6cf89f85b057 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:47.013060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fd3c632-0174-4d08-8ec2-6cf89f85b057 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:47.013846 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fd3c632-0174-4d08-8ec2-6cf89f85b057 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:47.014281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fd3c632-0174-4d08-8ec2-6cf89f85b057 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:47.166210 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0fd3c632-0174-4d08-8ec2-6cf89f85b057 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:47.175964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0fd3c632-0174-4d08-8ec2-6cf89f85b057 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:47.192128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0fd3c632-0174-4d08-8ec2-6cf89f85b057 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:47.193301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0fd3c632-0174-4d08-8ec2-6cf89f85b057 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1405 microversion: 2.20 time: 0.193884 Jul 28 03:37:47.193886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 33/83] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:46 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:47.234332 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fbbb9f96-9a9a-4320-9d44-707b0e4b4532 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ec55282-2555-4905-9457-038790dbfc38"}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:47.235671 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-fbbb9f96-9a9a-4320-9d44-707b0e4b4532 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:47.245414 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fbbb9f96-9a9a-4320-9d44-707b0e4b4532 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:47.246817 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fbbb9f96-9a9a-4320-9d44-707b0e4b4532 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:47.247901 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fbbb9f96-9a9a-4320-9d44-707b0e4b4532 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:47.248523 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fbbb9f96-9a9a-4320-9d44-707b0e4b4532 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:47.517320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8abec5fb-540f-4861-95a2-1fa0f3daf009 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:47.517937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8abec5fb-540f-4861-95a2-1fa0f3daf009 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:47.524300 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8abec5fb-540f-4861-95a2-1fa0f3daf009 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:47.524743 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8abec5fb-540f-4861-95a2-1fa0f3daf009 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:47.525507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8abec5fb-540f-4861-95a2-1fa0f3daf009 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:47.525968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8abec5fb-540f-4861-95a2-1fa0f3daf009 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:47.713550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8abec5fb-540f-4861-95a2-1fa0f3daf009 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:47.730486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8abec5fb-540f-4861-95a2-1fa0f3daf009 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1363 microversion: 2.1 time: 0.213939 Jul 28 03:37:47.731044 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-fbbb9f96-9a9a-4320-9d44-707b0e4b4532 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "POST /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501313 Jul 28 03:37:47.731854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 34/84] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:47 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:47.740424 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 51/85] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 03:37:47 2021] POST /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:47.903264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dd30d264-20cd-4d7a-bb37-a20fdb13307c tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac4e903e-7528-4a4b-bf0a-71f54c6df3a1"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:47.904462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dd30d264-20cd-4d7a-bb37-a20fdb13307c tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:47.912343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd30d264-20cd-4d7a-bb37-a20fdb13307c tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:47.913175 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd30d264-20cd-4d7a-bb37-a20fdb13307c tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:47.914289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd30d264-20cd-4d7a-bb37-a20fdb13307c tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:47.915215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd30d264-20cd-4d7a-bb37-a20fdb13307c tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:48.052839 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-ecc9163f-bbc5-4f77-a267-1f556c8a0f31 req-f945486e-533c-4cfc-ae31-cb5e974681a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622af242-a6fc-4f2d-9f03-61e88ee5e89f", "name": "network-vif-plugged", "status": "completed", "tag": "f743ec9f-b513-4bb3-b819-5c932959e75f"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:48.055249 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:48.055249 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:37:48.072740 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-ecc9163f-bbc5-4f77-a267-1f556c8a0f31 req-f945486e-533c-4cfc-ae31-cb5e974681a1 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:48.073164 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-ecc9163f-bbc5-4f77-a267-1f556c8a0f31 req-f945486e-533c-4cfc-ae31-cb5e974681a1 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:48.121455 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-ecc9163f-bbc5-4f77-a267-1f556c8a0f31 req-f945486e-533c-4cfc-ae31-cb5e974681a1 service nova] Creating event network-vif-plugged:f743ec9f-b513-4bb3-b819-5c932959e75f for instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f on hv-cinder-73306 Jul 28 03:37:48.128567 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-ecc9163f-bbc5-4f77-a267-1f556c8a0f31 req-f945486e-533c-4cfc-ae31-cb5e974681a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081632 Jul 28 03:37:48.129408 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 52/86] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:37:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:37:48.210875 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a957dfc9-2c84-4681-ac6b-f6a314e29998 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:48.212048 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a957dfc9-2c84-4681-ac6b-f6a314e29998 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:48.222952 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a957dfc9-2c84-4681-ac6b-f6a314e29998 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:48.223819 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a957dfc9-2c84-4681-ac6b-f6a314e29998 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:48.225206 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a957dfc9-2c84-4681-ac6b-f6a314e29998 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:48.225941 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a957dfc9-2c84-4681-ac6b-f6a314e29998 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:48.374308 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a957dfc9-2c84-4681-ac6b-f6a314e29998 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:48.384390 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a957dfc9-2c84-4681-ac6b-f6a314e29998 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:48.388278 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a957dfc9-2c84-4681-ac6b-f6a314e29998 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:48.390081 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a957dfc9-2c84-4681-ac6b-f6a314e29998 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1405 microversion: 2.20 time: 0.183296 Jul 28 03:37:48.401027 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 53/87] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:48 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:48.548313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dd30d264-20cd-4d7a-bb37-a20fdb13307c tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "POST /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.649528 Jul 28 03:37:48.559064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 35/88] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 03:37:47 2021] POST /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:48.747628 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-546bc086-e3c3-40f1-852a-c791a3f94fa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:48.758809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-546bc086-e3c3-40f1-852a-c791a3f94fa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:48.758809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-546bc086-e3c3-40f1-852a-c791a3f94fa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:48.758809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-546bc086-e3c3-40f1-852a-c791a3f94fa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:48.758809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-546bc086-e3c3-40f1-852a-c791a3f94fa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:48.759069 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-546bc086-e3c3-40f1-852a-c791a3f94fa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:48.930479 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-546bc086-e3c3-40f1-852a-c791a3f94fa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:48.938773 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-546bc086-e3c3-40f1-852a-c791a3f94fa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1363 microversion: 2.1 time: 0.195557 Jul 28 03:37:48.939523 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 54/89] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:48 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:49.409943 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-844f6b26-252d-4640-a5bb-3d066b8070c8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:49.410642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-844f6b26-252d-4640-a5bb-3d066b8070c8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:49.420082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-844f6b26-252d-4640-a5bb-3d066b8070c8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:49.420082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-844f6b26-252d-4640-a5bb-3d066b8070c8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:49.420651 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-844f6b26-252d-4640-a5bb-3d066b8070c8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:49.421006 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-844f6b26-252d-4640-a5bb-3d066b8070c8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:49.552830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-844f6b26-252d-4640-a5bb-3d066b8070c8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.560887 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-844f6b26-252d-4640-a5bb-3d066b8070c8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.562531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-844f6b26-252d-4640-a5bb-3d066b8070c8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.563764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-844f6b26-252d-4640-a5bb-3d066b8070c8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1405 microversion: 2.20 time: 0.157821 Jul 28 03:37:49.564317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 36/90] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:49 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:49.957374 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-57626336-6410-45cd-9a32-922e6daec0b8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:49.958791 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-57626336-6410-45cd-9a32-922e6daec0b8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:49.975999 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-57626336-6410-45cd-9a32-922e6daec0b8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:49.976901 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-57626336-6410-45cd-9a32-922e6daec0b8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:49.977973 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-57626336-6410-45cd-9a32-922e6daec0b8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:49.978651 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-57626336-6410-45cd-9a32-922e6daec0b8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:50.133192 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-57626336-6410-45cd-9a32-922e6daec0b8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:50.149085 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-57626336-6410-45cd-9a32-922e6daec0b8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1363 microversion: 2.1 time: 0.195696 Jul 28 03:37:50.149661 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 55/91] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:49 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:50.158203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-07a8dc10-3e62-4310-979e-916edcad688e req-1a64ecca-3a3f-456a-837b-968d864c9af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0eb74a9-c89c-4863-9431-4de9be74c41c", "name": "network-vif-plugged", "status": "completed", "tag": "e78fba6c-176b-4f20-8246-8712019f721a"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:50.159802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:50.159802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:37:50.167908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-07a8dc10-3e62-4310-979e-916edcad688e req-1a64ecca-3a3f-456a-837b-968d864c9af3 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:50.171543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-07a8dc10-3e62-4310-979e-916edcad688e req-1a64ecca-3a3f-456a-837b-968d864c9af3 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:50.183520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-07a8dc10-3e62-4310-979e-916edcad688e req-1a64ecca-3a3f-456a-837b-968d864c9af3 service nova] Creating event network-vif-plugged:e78fba6c-176b-4f20-8246-8712019f721a for instance c0eb74a9-c89c-4863-9431-4de9be74c41c on hv-cinder-73306 Jul 28 03:37:50.188501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-07a8dc10-3e62-4310-979e-916edcad688e req-1a64ecca-3a3f-456a-837b-968d864c9af3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033821 Jul 28 03:37:50.189264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 37/92] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:37:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:50.585538 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-62b0fbe8-2ace-4373-9c8f-cf6e7d9602c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:50.586541 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-62b0fbe8-2ace-4373-9c8f-cf6e7d9602c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:50.595149 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-62b0fbe8-2ace-4373-9c8f-cf6e7d9602c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:50.595649 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-62b0fbe8-2ace-4373-9c8f-cf6e7d9602c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:50.596556 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-62b0fbe8-2ace-4373-9c8f-cf6e7d9602c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:50.597032 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-62b0fbe8-2ace-4373-9c8f-cf6e7d9602c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:50.747798 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-62b0fbe8-2ace-4373-9c8f-cf6e7d9602c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:50.756082 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-62b0fbe8-2ace-4373-9c8f-cf6e7d9602c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:50.757595 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-62b0fbe8-2ace-4373-9c8f-cf6e7d9602c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:50.758725 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-62b0fbe8-2ace-4373-9c8f-cf6e7d9602c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1596 microversion: 2.20 time: 0.180113 Jul 28 03:37:50.759272 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 56/93] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:37:50 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1596 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:50.777099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-04fdc933-b207-4402-b7ce-75ac8c32893d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:50.777830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-04fdc933-b207-4402-b7ce-75ac8c32893d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:50.784100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04fdc933-b207-4402-b7ce-75ac8c32893d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:50.784555 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04fdc933-b207-4402-b7ce-75ac8c32893d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:50.785320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04fdc933-b207-4402-b7ce-75ac8c32893d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:50.785764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04fdc933-b207-4402-b7ce-75ac8c32893d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:50.864588 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-04fdc933-b207-4402-b7ce-75ac8c32893d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091644 Jul 28 03:37:50.865171 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 38/94] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Jul 28 03:37:50 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:37:51.172754 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7f5ff0ad-0fea-4ecd-905f-994658334d8a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:51.173418 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-7f5ff0ad-0fea-4ecd-905f-994658334d8a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:51.179458 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f5ff0ad-0fea-4ecd-905f-994658334d8a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:51.179936 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f5ff0ad-0fea-4ecd-905f-994658334d8a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:51.180709 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f5ff0ad-0fea-4ecd-905f-994658334d8a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:51.181163 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f5ff0ad-0fea-4ecd-905f-994658334d8a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:51.336919 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-7f5ff0ad-0fea-4ecd-905f-994658334d8a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:51.345917 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-7f5ff0ad-0fea-4ecd-905f-994658334d8a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1363 microversion: 2.1 time: 0.177007 Jul 28 03:37:51.346796 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 57/95] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:51 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:52.333549 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-ea6e320b-42c2-40a7-8b1b-5ce970af903c req-c9fcf376-8c74-4c7e-b8e2-075bbec0d456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622af242-a6fc-4f2d-9f03-61e88ee5e89f", "tag": "f743ec9f-b513-4bb3-b819-5c932959e75f"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:52.336878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0de8530d-5442-4a9b-843d-cae52d544ae2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:52.337848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0de8530d-5442-4a9b-843d-cae52d544ae2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:52.341689 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:52.341689 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:37:52.344904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0de8530d-5442-4a9b-843d-cae52d544ae2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:52.345349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0de8530d-5442-4a9b-843d-cae52d544ae2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:52.346111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0de8530d-5442-4a9b-843d-cae52d544ae2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:52.346544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0de8530d-5442-4a9b-843d-cae52d544ae2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:52.348980 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-ea6e320b-42c2-40a7-8b1b-5ce970af903c req-c9fcf376-8c74-4c7e-b8e2-075bbec0d456 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:52.349623 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-ea6e320b-42c2-40a7-8b1b-5ce970af903c req-c9fcf376-8c74-4c7e-b8e2-075bbec0d456 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:52.361346 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-ea6e320b-42c2-40a7-8b1b-5ce970af903c req-c9fcf376-8c74-4c7e-b8e2-075bbec0d456 service nova] Creating event network-changed:f743ec9f-b513-4bb3-b819-5c932959e75f for instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f on hv-cinder-73306 Jul 28 03:37:52.367323 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-ea6e320b-42c2-40a7-8b1b-5ce970af903c req-c9fcf376-8c74-4c7e-b8e2-075bbec0d456 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037453 Jul 28 03:37:52.368048 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 58/96] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:37:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:52.373893 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-94a04cec-15fb-469c-88c0-f0edc4043594 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:52.374641 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-94a04cec-15fb-469c-88c0-f0edc4043594 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:52.381223 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94a04cec-15fb-469c-88c0-f0edc4043594 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:52.381675 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94a04cec-15fb-469c-88c0-f0edc4043594 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:52.382458 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94a04cec-15fb-469c-88c0-f0edc4043594 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:52.382892 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94a04cec-15fb-469c-88c0-f0edc4043594 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:52.501099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0de8530d-5442-4a9b-843d-cae52d544ae2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.174257 Jul 28 03:37:52.501730 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 39/97] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:37:52 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:52.529563 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-94a04cec-15fb-469c-88c0-f0edc4043594 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:52.537268 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-94a04cec-15fb-469c-88c0-f0edc4043594 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1548 microversion: 2.1 time: 0.167542 Jul 28 03:37:52.537849 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 59/98] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:52 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:52.556950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4999e86a-795e-4c12-b529-8367e627423c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:52.557508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4999e86a-795e-4c12-b529-8367e627423c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:52.565217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4999e86a-795e-4c12-b529-8367e627423c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:52.565701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4999e86a-795e-4c12-b529-8367e627423c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:52.566543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4999e86a-795e-4c12-b529-8367e627423c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:52.567015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4999e86a-795e-4c12-b529-8367e627423c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:52.689402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4999e86a-795e-4c12-b529-8367e627423c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137298 Jul 28 03:37:52.701179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 40/99] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Jul 28 03:37:52 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:37:53.520216 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-51c5dfbb-a25b-48ef-bbb1-af83f94448ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:53.520216 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-51c5dfbb-a25b-48ef-bbb1-af83f94448ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:53.527642 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-51c5dfbb-a25b-48ef-bbb1-af83f94448ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:53.528198 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-51c5dfbb-a25b-48ef-bbb1-af83f94448ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:53.529054 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-51c5dfbb-a25b-48ef-bbb1-af83f94448ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:53.529546 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-51c5dfbb-a25b-48ef-bbb1-af83f94448ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:53.633369 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-51c5dfbb-a25b-48ef-bbb1-af83f94448ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.123881 Jul 28 03:37:53.639682 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 60/100] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:37:53 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:54.264203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0b162517-9865-430e-82d8-c5bb31770799 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:54.265136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0b162517-9865-430e-82d8-c5bb31770799 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:54.273620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0b162517-9865-430e-82d8-c5bb31770799 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:54.273969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0b162517-9865-430e-82d8-c5bb31770799 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:54.274771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0b162517-9865-430e-82d8-c5bb31770799 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:54.275211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0b162517-9865-430e-82d8-c5bb31770799 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:54.283621 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-8c897e26-07a4-4a39-b62f-1b604e7c7105 req-2e80bacc-7d7b-47bc-b9f4-06d78296103b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0eb74a9-c89c-4863-9431-4de9be74c41c", "tag": "e78fba6c-176b-4f20-8246-8712019f721a"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:54.285727 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:54.285727 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:37:54.297482 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-8c897e26-07a4-4a39-b62f-1b604e7c7105 req-2e80bacc-7d7b-47bc-b9f4-06d78296103b service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:54.298222 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-8c897e26-07a4-4a39-b62f-1b604e7c7105 req-2e80bacc-7d7b-47bc-b9f4-06d78296103b service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:54.356414 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-8c897e26-07a4-4a39-b62f-1b604e7c7105 req-2e80bacc-7d7b-47bc-b9f4-06d78296103b service nova] Creating event network-changed:e78fba6c-176b-4f20-8246-8712019f721a for instance c0eb74a9-c89c-4863-9431-4de9be74c41c on hv-cinder-73306 Jul 28 03:37:54.362488 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-8c897e26-07a4-4a39-b62f-1b604e7c7105 req-2e80bacc-7d7b-47bc-b9f4-06d78296103b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082628 Jul 28 03:37:54.363631 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 61/101] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:37:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:54.498345 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0b162517-9865-430e-82d8-c5bb31770799 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 0.238039 Jul 28 03:37:54.499424 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 41/102] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:37:54 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:54.653693 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-599c3342-9b2a-4701-b362-a82d4704d39c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:54.655310 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-599c3342-9b2a-4701-b362-a82d4704d39c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:54.664717 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-599c3342-9b2a-4701-b362-a82d4704d39c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:54.666242 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-599c3342-9b2a-4701-b362-a82d4704d39c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:54.668010 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-599c3342-9b2a-4701-b362-a82d4704d39c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:54.669020 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-599c3342-9b2a-4701-b362-a82d4704d39c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:54.778605 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-599c3342-9b2a-4701-b362-a82d4704d39c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.135059 Jul 28 03:37:54.781581 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 62/103] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:37:54 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:55.526490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-537d9778-f4a2-4a5c-8f86-ee10c646e62e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:55.530037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-537d9778-f4a2-4a5c-8f86-ee10c646e62e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:55.542037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-537d9778-f4a2-4a5c-8f86-ee10c646e62e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:55.546295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-537d9778-f4a2-4a5c-8f86-ee10c646e62e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:55.548903 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-537d9778-f4a2-4a5c-8f86-ee10c646e62e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:55.549295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-537d9778-f4a2-4a5c-8f86-ee10c646e62e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:55.716370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-537d9778-f4a2-4a5c-8f86-ee10c646e62e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 0.210270 Jul 28 03:37:55.716994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 42/104] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:37:55 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:37:55.792811 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b1357d6f-ccae-4306-a4a5-cc4d049e1e7d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:55.794733 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b1357d6f-ccae-4306-a4a5-cc4d049e1e7d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:55.801656 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b1357d6f-ccae-4306-a4a5-cc4d049e1e7d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:55.802389 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b1357d6f-ccae-4306-a4a5-cc4d049e1e7d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:55.803356 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b1357d6f-ccae-4306-a4a5-cc4d049e1e7d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:55.804007 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b1357d6f-ccae-4306-a4a5-cc4d049e1e7d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:55.938534 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b1357d6f-ccae-4306-a4a5-cc4d049e1e7d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.149668 Jul 28 03:37:55.941687 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 63/105] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:37:55 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:56.727575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-16dab1c5-61fb-40d1-8d95-d630ffa6d922 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:56.728610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-16dab1c5-61fb-40d1-8d95-d630ffa6d922 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:56.736983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16dab1c5-61fb-40d1-8d95-d630ffa6d922 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:56.737322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16dab1c5-61fb-40d1-8d95-d630ffa6d922 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:56.738110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16dab1c5-61fb-40d1-8d95-d630ffa6d922 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:56.738535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16dab1c5-61fb-40d1-8d95-d630ffa6d922 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:56.881896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-16dab1c5-61fb-40d1-8d95-d630ffa6d922 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 0.157908 Jul 28 03:37:56.882883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 43/106] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:37:56 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:56.952878 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2a065932-0859-44cf-82ff-09f4a89f2c4e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:56.953483 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2a065932-0859-44cf-82ff-09f4a89f2c4e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:56.961143 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2a065932-0859-44cf-82ff-09f4a89f2c4e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:56.961634 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2a065932-0859-44cf-82ff-09f4a89f2c4e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:56.962849 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2a065932-0859-44cf-82ff-09f4a89f2c4e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:56.963469 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2a065932-0859-44cf-82ff-09f4a89f2c4e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:57.096332 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2a065932-0859-44cf-82ff-09f4a89f2c4e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.148050 Jul 28 03:37:57.099539 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 64/107] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:37:56 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:57.641045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-180314290", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "networks": [{"uuid": "907c8c72-fbe1-4216-965a-39395c1cad68"}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:57.701890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] validate_networks() for [('907c8c72-fbe1-4216-965a-39395c1cad68', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:37:57.894307 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-9e967afd-47c8-4a6b-922e-ed92ed79df95 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:57.895593 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-9e967afd-47c8-4a6b-922e-ed92ed79df95 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:57.907974 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9e967afd-47c8-4a6b-922e-ed92ed79df95 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:57.912393 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9e967afd-47c8-4a6b-922e-ed92ed79df95 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:57.920527 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9e967afd-47c8-4a6b-922e-ed92ed79df95 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:57.924492 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9e967afd-47c8-4a6b-922e-ed92ed79df95 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:58.051272 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-9e967afd-47c8-4a6b-922e-ed92ed79df95 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 0.159830 Jul 28 03:37:58.057055 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 65/108] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:37:57 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:58.108677 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fa1435f8-ab3b-451c-9c2e-99946d066c85 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:58.109707 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-fa1435f8-ab3b-451c-9c2e-99946d066c85 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:58.116989 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fa1435f8-ab3b-451c-9c2e-99946d066c85 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:58.117653 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fa1435f8-ab3b-451c-9c2e-99946d066c85 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:58.118618 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fa1435f8-ab3b-451c-9c2e-99946d066c85 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:58.125748 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fa1435f8-ab3b-451c-9c2e-99946d066c85 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:58.130653 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:58.131861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:58.132622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:58.133206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:58.133949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:58.149686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:58.150296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:58.151260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:58.151752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:58.180523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Getting quotas for project da239fd2931445e6be6459a0225fbd85. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:37:58.185657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Getting quotas for user f3ecf43d42c74783a82bf45afd8826e8 and project da239fd2931445e6be6459a0225fbd85. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:37:58.197882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:37:58.200923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:37:58.262407 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-fa1435f8-ab3b-451c-9c2e-99946d066c85 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.157426 Jul 28 03:37:58.262407 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 66/109] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:37:58 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:58.263694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fb1fdf5c-2113-401b-aced-981612663f21 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626983 Jul 28 03:37:58.264360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 44/110] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:37:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:37:58.277883 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-253decc7-d642-495a-8f56-b31187849f69 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:58.278547 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-253decc7-d642-495a-8f56-b31187849f69 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:58.363278 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-253decc7-d642-495a-8f56-b31187849f69 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:58.376123 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-253decc7-d642-495a-8f56-b31187849f69 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1217 microversion: 2.1 time: 0.103611 Jul 28 03:37:58.376934 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 67/111] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:58 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:59.069478 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0d80118b-15f8-4676-b07f-d1cee5053512 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:59.070589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0d80118b-15f8-4676-b07f-d1cee5053512 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:59.082521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d80118b-15f8-4676-b07f-d1cee5053512 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:59.083340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d80118b-15f8-4676-b07f-d1cee5053512 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:59.084478 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d80118b-15f8-4676-b07f-d1cee5053512 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:59.085147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d80118b-15f8-4676-b07f-d1cee5053512 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:59.202763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0d80118b-15f8-4676-b07f-d1cee5053512 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 0.137485 Jul 28 03:37:59.203432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 45/112] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:37:59 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:59.274680 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-14bb9b52-99cf-4833-b68e-e2132168fedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:59.277170 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-14bb9b52-99cf-4833-b68e-e2132168fedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:59.284729 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-14bb9b52-99cf-4833-b68e-e2132168fedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:59.285175 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-14bb9b52-99cf-4833-b68e-e2132168fedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:59.285941 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-14bb9b52-99cf-4833-b68e-e2132168fedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:59.286366 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-14bb9b52-99cf-4833-b68e-e2132168fedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:59.395981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8516916e-fd68-4c38-ab9c-5bb689852207 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:59.395981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8516916e-fd68-4c38-ab9c-5bb689852207 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:37:59.399638 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-14bb9b52-99cf-4833-b68e-e2132168fedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.129913 Jul 28 03:37:59.400857 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 68/113] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:37:59 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:59.401167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8516916e-fd68-4c38-ab9c-5bb689852207 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:59.402156 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8516916e-fd68-4c38-ab9c-5bb689852207 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:59.403509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8516916e-fd68-4c38-ab9c-5bb689852207 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:37:59.403996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8516916e-fd68-4c38-ab9c-5bb689852207 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:37:59.486764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8516916e-fd68-4c38-ab9c-5bb689852207 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:59.496060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8516916e-fd68-4c38-ab9c-5bb689852207 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1269 microversion: 2.1 time: 0.106335 Jul 28 03:37:59.496741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 46/114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:37:59 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1269 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:00.215975 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-83f6715b-ec18-4c82-9ca4-5efd0dfb651b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:00.217329 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-83f6715b-ec18-4c82-9ca4-5efd0dfb651b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:00.225140 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-83f6715b-ec18-4c82-9ca4-5efd0dfb651b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:00.225918 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-83f6715b-ec18-4c82-9ca4-5efd0dfb651b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:00.226904 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-83f6715b-ec18-4c82-9ca4-5efd0dfb651b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:00.227615 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-83f6715b-ec18-4c82-9ca4-5efd0dfb651b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:00.332378 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-83f6715b-ec18-4c82-9ca4-5efd0dfb651b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 0.121118 Jul 28 03:38:00.333274 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 69/115] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:00 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:38:00.410979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-94ff62e9-2381-404b-8292-9b404815e353 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:00.412110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-94ff62e9-2381-404b-8292-9b404815e353 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:00.420656 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-94ff62e9-2381-404b-8292-9b404815e353 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:00.421113 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-94ff62e9-2381-404b-8292-9b404815e353 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:00.421901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-94ff62e9-2381-404b-8292-9b404815e353 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:00.422340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-94ff62e9-2381-404b-8292-9b404815e353 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:00.517770 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1b63e2c0-969e-4aca-9a3d-5c62dc123f70 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:00.518748 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1b63e2c0-969e-4aca-9a3d-5c62dc123f70 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:00.527511 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1b63e2c0-969e-4aca-9a3d-5c62dc123f70 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:00.528034 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1b63e2c0-969e-4aca-9a3d-5c62dc123f70 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:00.528920 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1b63e2c0-969e-4aca-9a3d-5c62dc123f70 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:00.529431 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1b63e2c0-969e-4aca-9a3d-5c62dc123f70 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:00.563401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-94ff62e9-2381-404b-8292-9b404815e353 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.155667 Jul 28 03:38:00.564120 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 47/116] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:00 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:00.786335 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1b63e2c0-969e-4aca-9a3d-5c62dc123f70 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:00.794210 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1b63e2c0-969e-4aca-9a3d-5c62dc123f70 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1317 microversion: 2.1 time: 0.284085 Jul 28 03:38:00.795056 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 70/117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:00 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:01.293058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-eeb8a8e1-187f-4e09-9af5-ac574ff5eef0 req-9d903498-8cce-4b75-b46b-972c9b7c88d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be21cb5-8869-41a2-9866-431b1d401f62", "tag": "3dd4657d-306f-494f-8116-d5a46c725169"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:01.294948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:01.294948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:38:01.311145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-eeb8a8e1-187f-4e09-9af5-ac574ff5eef0 req-9d903498-8cce-4b75-b46b-972c9b7c88d5 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:01.312029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-eeb8a8e1-187f-4e09-9af5-ac574ff5eef0 req-9d903498-8cce-4b75-b46b-972c9b7c88d5 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:01.329620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-eeb8a8e1-187f-4e09-9af5-ac574ff5eef0 req-9d903498-8cce-4b75-b46b-972c9b7c88d5 service nova] Creating event network-changed:3dd4657d-306f-494f-8116-d5a46c725169 for instance 7be21cb5-8869-41a2-9866-431b1d401f62 on hv-cinder-73306 Jul 28 03:38:01.334604 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-eeb8a8e1-187f-4e09-9af5-ac574ff5eef0 req-9d903498-8cce-4b75-b46b-972c9b7c88d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055011 Jul 28 03:38:01.335200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 48/118] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:38:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:01.343611 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-9e2762a7-f41d-48b9-acf9-9ad02308c4ca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:01.344870 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-9e2762a7-f41d-48b9-acf9-9ad02308c4ca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:01.351215 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9e2762a7-f41d-48b9-acf9-9ad02308c4ca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:01.351754 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9e2762a7-f41d-48b9-acf9-9ad02308c4ca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:01.352582 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9e2762a7-f41d-48b9-acf9-9ad02308c4ca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:01.353071 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9e2762a7-f41d-48b9-acf9-9ad02308c4ca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:01.488206 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-9e2762a7-f41d-48b9-acf9-9ad02308c4ca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 0.148278 Jul 28 03:38:01.492783 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 71/119] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:01 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:38:01.577034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0f9990ec-109d-4958-9990-75a2d730ca46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:01.579010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0f9990ec-109d-4958-9990-75a2d730ca46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:01.587897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f9990ec-109d-4958-9990-75a2d730ca46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:01.590630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f9990ec-109d-4958-9990-75a2d730ca46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:01.591736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f9990ec-109d-4958-9990-75a2d730ca46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:01.594694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f9990ec-109d-4958-9990-75a2d730ca46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:01.736708 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0f9990ec-109d-4958-9990-75a2d730ca46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.165326 Jul 28 03:38:01.737343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 49/120] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:01 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:01.812529 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8ea37795-19b0-4a7a-a3a3-12642bb01988 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:01.813252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8ea37795-19b0-4a7a-a3a3-12642bb01988 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:01.827500 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8ea37795-19b0-4a7a-a3a3-12642bb01988 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:01.827987 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8ea37795-19b0-4a7a-a3a3-12642bb01988 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:01.836193 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8ea37795-19b0-4a7a-a3a3-12642bb01988 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:01.836898 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8ea37795-19b0-4a7a-a3a3-12642bb01988 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:02.027924 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-8ea37795-19b0-4a7a-a3a3-12642bb01988 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:02.041038 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8ea37795-19b0-4a7a-a3a3-12642bb01988 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1317 microversion: 2.1 time: 0.233252 Jul 28 03:38:02.049656 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 72/121] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:01 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:02.503173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-32f974a1-4763-4858-a15d-ae2db9e8d54b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:02.504662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-32f974a1-4763-4858-a15d-ae2db9e8d54b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:02.514101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32f974a1-4763-4858-a15d-ae2db9e8d54b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:02.514515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32f974a1-4763-4858-a15d-ae2db9e8d54b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:02.515304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32f974a1-4763-4858-a15d-ae2db9e8d54b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:02.515768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32f974a1-4763-4858-a15d-ae2db9e8d54b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:02.680983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-32f974a1-4763-4858-a15d-ae2db9e8d54b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 0.182640 Jul 28 03:38:02.681714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 50/122] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:02 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:38:02.748296 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-35a5c511-0ea4-43e5-9eab-2a30ba50f70b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:02.749786 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-35a5c511-0ea4-43e5-9eab-2a30ba50f70b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:02.756592 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-35a5c511-0ea4-43e5-9eab-2a30ba50f70b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:02.757040 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-35a5c511-0ea4-43e5-9eab-2a30ba50f70b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:02.757818 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-35a5c511-0ea4-43e5-9eab-2a30ba50f70b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:02.758508 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-35a5c511-0ea4-43e5-9eab-2a30ba50f70b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:02.935825 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-35a5c511-0ea4-43e5-9eab-2a30ba50f70b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.191869 Jul 28 03:38:02.939210 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 73/123] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:02 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:03.063005 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4734bf1c-1504-426a-81f5-3c6400be6448 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:03.063872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4734bf1c-1504-426a-81f5-3c6400be6448 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:03.070170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4734bf1c-1504-426a-81f5-3c6400be6448 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:03.070827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4734bf1c-1504-426a-81f5-3c6400be6448 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:03.071613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4734bf1c-1504-426a-81f5-3c6400be6448 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:03.072086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4734bf1c-1504-426a-81f5-3c6400be6448 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:03.215513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4734bf1c-1504-426a-81f5-3c6400be6448 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:03.224164 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4734bf1c-1504-426a-81f5-3c6400be6448 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1317 microversion: 2.1 time: 0.165440 Jul 28 03:38:03.224864 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 51/124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:03 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:03.694385 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-72ef0f96-43c9-451e-aa6d-07b324df85f9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:03.695614 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-72ef0f96-43c9-451e-aa6d-07b324df85f9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:03.705164 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-72ef0f96-43c9-451e-aa6d-07b324df85f9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:03.705742 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-72ef0f96-43c9-451e-aa6d-07b324df85f9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:03.706598 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-72ef0f96-43c9-451e-aa6d-07b324df85f9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:03.707156 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-72ef0f96-43c9-451e-aa6d-07b324df85f9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:03.823125 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-72ef0f96-43c9-451e-aa6d-07b324df85f9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 0.133420 Jul 28 03:38:03.827040 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 74/125] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:03 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:38:03.947950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f1e57cdf-8bda-4844-824e-0c37fee06aff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:03.948997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f1e57cdf-8bda-4844-824e-0c37fee06aff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:03.956952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1e57cdf-8bda-4844-824e-0c37fee06aff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:03.956952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1e57cdf-8bda-4844-824e-0c37fee06aff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:03.957757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1e57cdf-8bda-4844-824e-0c37fee06aff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:03.957757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1e57cdf-8bda-4844-824e-0c37fee06aff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:04.242137 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-3b7733cb-5403-463f-8cab-3e7435bb5364 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:04.242908 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-3b7733cb-5403-463f-8cab-3e7435bb5364 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:04.249696 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3b7733cb-5403-463f-8cab-3e7435bb5364 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:04.250146 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3b7733cb-5403-463f-8cab-3e7435bb5364 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:04.250926 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3b7733cb-5403-463f-8cab-3e7435bb5364 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:04.251360 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3b7733cb-5403-463f-8cab-3e7435bb5364 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:04.388673 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3b7733cb-5403-463f-8cab-3e7435bb5364 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:04.396559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-3b7733cb-5403-463f-8cab-3e7435bb5364 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1317 microversion: 2.1 time: 0.158551 Jul 28 03:38:04.397410 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 75/126] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:04 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:04.790238 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1507cd22-c39e-4331-bb02-180432fdb629 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:04.790801 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1507cd22-c39e-4331-bb02-180432fdb629 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:04.797896 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1507cd22-c39e-4331-bb02-180432fdb629 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:04.798521 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1507cd22-c39e-4331-bb02-180432fdb629 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:04.799938 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1507cd22-c39e-4331-bb02-180432fdb629 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:04.800589 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1507cd22-c39e-4331-bb02-180432fdb629 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:04.828442 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1507cd22-c39e-4331-bb02-180432fdb629 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Going to try to terminate instance {{(pid=119155) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:38:04.942203 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1507cd22-c39e-4331-bb02-180432fdb629 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 204 len: 0 microversion: 2.1 time: 0.155242 Jul 28 03:38:04.943029 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 76/127] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:38:04 2021] DELETE /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:38:04.947889 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2d078eea-d69c-42b8-875d-fbf85d0c28f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:04.949436 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2d078eea-d69c-42b8-875d-fbf85d0c28f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:04.955538 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d078eea-d69c-42b8-875d-fbf85d0c28f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:04.956008 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d078eea-d69c-42b8-875d-fbf85d0c28f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:04.956905 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d078eea-d69c-42b8-875d-fbf85d0c28f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:04.957348 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d078eea-d69c-42b8-875d-fbf85d0c28f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:07.404218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f1e57cdf-8bda-4844-824e-0c37fee06aff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 3.460610 Jul 28 03:38:07.407400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 52/128] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:03 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 3463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:07.410185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-33569996-06ea-46d7-9009-1997d04c3e2f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:07.410969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-33569996-06ea-46d7-9009-1997d04c3e2f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:07.418445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-33569996-06ea-46d7-9009-1997d04c3e2f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:07.419012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-33569996-06ea-46d7-9009-1997d04c3e2f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:07.420078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-33569996-06ea-46d7-9009-1997d04c3e2f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:07.420591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-33569996-06ea-46d7-9009-1997d04c3e2f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:07.549190 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2d078eea-d69c-42b8-875d-fbf85d0c28f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 2.604948 Jul 28 03:38:07.550326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-33569996-06ea-46d7-9009-1997d04c3e2f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:07.554569 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 77/129] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:04 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 2611 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:38:07.559254 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-33569996-06ea-46d7-9009-1997d04c3e2f tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.153049 Jul 28 03:38:07.559876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 53/130] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:07 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:07.563277 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a2d11f76-8de3-4b0a-8ea9-2bf63daa325a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:07.564280 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a2d11f76-8de3-4b0a-8ea9-2bf63daa325a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:07.572140 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a2d11f76-8de3-4b0a-8ea9-2bf63daa325a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:07.572599 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a2d11f76-8de3-4b0a-8ea9-2bf63daa325a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:07.573692 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a2d11f76-8de3-4b0a-8ea9-2bf63daa325a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:07.574561 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a2d11f76-8de3-4b0a-8ea9-2bf63daa325a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:07.715503 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a2d11f76-8de3-4b0a-8ea9-2bf63daa325a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:07.722930 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a2d11f76-8de3-4b0a-8ea9-2bf63daa325a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1317 microversion: 2.1 time: 0.165888 Jul 28 03:38:07.723487 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 78/131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:07 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:08.415103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-17e516c4-21f9-4fae-9fab-ca2cfe622d67 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:08.416699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-17e516c4-21f9-4fae-9fab-ca2cfe622d67 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:08.425918 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17e516c4-21f9-4fae-9fab-ca2cfe622d67 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:08.426633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17e516c4-21f9-4fae-9fab-ca2cfe622d67 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:08.427638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17e516c4-21f9-4fae-9fab-ca2cfe622d67 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:08.428451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17e516c4-21f9-4fae-9fab-ca2cfe622d67 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:08.535217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-17e516c4-21f9-4fae-9fab-ca2cfe622d67 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 14 microversion: 2.20 time: 0.123804 Jul 28 03:38:08.535865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 54/132] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:08 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:08.561248 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8d25bfde-b449-4ade-8943-41221ec1147e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:08.562161 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8d25bfde-b449-4ade-8943-41221ec1147e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:08.568273 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8d25bfde-b449-4ade-8943-41221ec1147e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:08.568910 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8d25bfde-b449-4ade-8943-41221ec1147e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:08.569853 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8d25bfde-b449-4ade-8943-41221ec1147e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:08.578914 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8d25bfde-b449-4ade-8943-41221ec1147e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:08.579882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-76d55531-e504-45ae-b5dc-fff2a01c26c0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:08.580674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-76d55531-e504-45ae-b5dc-fff2a01c26c0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:08.588350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76d55531-e504-45ae-b5dc-fff2a01c26c0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:08.590156 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76d55531-e504-45ae-b5dc-fff2a01c26c0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:08.591781 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76d55531-e504-45ae-b5dc-fff2a01c26c0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:08.592529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76d55531-e504-45ae-b5dc-fff2a01c26c0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:08.687049 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8d25bfde-b449-4ade-8943-41221ec1147e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 14 microversion: 2.1 time: 0.129595 Jul 28 03:38:08.688964 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 79/133] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:08 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:38:08.738328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-76d55531-e504-45ae-b5dc-fff2a01c26c0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:08.741091 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-bf4c1d6c-c7b4-4ad7-926d-6a837362b17f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:08.741790 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-bf4c1d6c-c7b4-4ad7-926d-6a837362b17f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:08.747295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-76d55531-e504-45ae-b5dc-fff2a01c26c0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.174157 Jul 28 03:38:08.748075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 55/134] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:08 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:08.750478 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bf4c1d6c-c7b4-4ad7-926d-6a837362b17f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:08.750923 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bf4c1d6c-c7b4-4ad7-926d-6a837362b17f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:08.751956 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bf4c1d6c-c7b4-4ad7-926d-6a837362b17f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:08.752466 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bf4c1d6c-c7b4-4ad7-926d-6a837362b17f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:08.910541 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-bf4c1d6c-c7b4-4ad7-926d-6a837362b17f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:08.918772 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-bf4c1d6c-c7b4-4ad7-926d-6a837362b17f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1317 microversion: 2.1 time: 0.181677 Jul 28 03:38:08.919558 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 80/135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:08 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:09.497904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-f1f43beb-fe70-46d3-90f3-902b36d8acf5 req-9197d0a8-66bc-4844-b796-cd4c995cda90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be21cb5-8869-41a2-9866-431b1d401f62", "name": "network-vif-plugged", "status": "completed", "tag": "3dd4657d-306f-494f-8116-d5a46c725169"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:09.500031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:09.500031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:38:09.506770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-f1f43beb-fe70-46d3-90f3-902b36d8acf5 req-9197d0a8-66bc-4844-b796-cd4c995cda90 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:09.508105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-f1f43beb-fe70-46d3-90f3-902b36d8acf5 req-9197d0a8-66bc-4844-b796-cd4c995cda90 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:09.519799 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-f1f43beb-fe70-46d3-90f3-902b36d8acf5 req-9197d0a8-66bc-4844-b796-cd4c995cda90 service nova] Creating event network-vif-plugged:3dd4657d-306f-494f-8116-d5a46c725169 for instance 7be21cb5-8869-41a2-9866-431b1d401f62 on hv-cinder-73306 Jul 28 03:38:09.524974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-f1f43beb-fe70-46d3-90f3-902b36d8acf5 req-9197d0a8-66bc-4844-b796-cd4c995cda90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Jul 28 03:38:09.525665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 56/136] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:38:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:38:09.545901 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-9f527c05-a428-4a28-8ff0-0ef02e56c946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:09.546802 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-9f527c05-a428-4a28-8ff0-0ef02e56c946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:09.553392 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9f527c05-a428-4a28-8ff0-0ef02e56c946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:09.553851 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9f527c05-a428-4a28-8ff0-0ef02e56c946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:09.554648 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9f527c05-a428-4a28-8ff0-0ef02e56c946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:09.555127 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9f527c05-a428-4a28-8ff0-0ef02e56c946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:09.699261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a6db4362-a0f0-4785-b6d6-c20fb368929d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:09.700299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a6db4362-a0f0-4785-b6d6-c20fb368929d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:09.706276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6db4362-a0f0-4785-b6d6-c20fb368929d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:09.706721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6db4362-a0f0-4785-b6d6-c20fb368929d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:09.707507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6db4362-a0f0-4785-b6d6-c20fb368929d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:09.707963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6db4362-a0f0-4785-b6d6-c20fb368929d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:12.790919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a6db4362-a0f0-4785-b6d6-c20fb368929d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 15025 microversion: 2.1 time: 3.095644 Jul 28 03:38:12.791573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 57/137] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:09 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 15025 bytes in 3097 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:38:12.796571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8895674f-7272-46d8-949f-28a4ff6a6691 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:12.797278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8895674f-7272-46d8-949f-28a4ff6a6691 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:12.803578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8895674f-7272-46d8-949f-28a4ff6a6691 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:12.804047 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8895674f-7272-46d8-949f-28a4ff6a6691 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:12.804805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8895674f-7272-46d8-949f-28a4ff6a6691 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:12.805237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8895674f-7272-46d8-949f-28a4ff6a6691 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:12.816272 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-9f527c05-a428-4a28-8ff0-0ef02e56c946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 15025 microversion: 2.20 time: 3.274407 Jul 28 03:38:12.816910 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 81/138] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:09 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 15025 bytes in 3276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:12.821913 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-4b2a818f-fb58-45f6-a686-c545cf57d0c6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:12.822724 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-4b2a818f-fb58-45f6-a686-c545cf57d0c6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:12.830604 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4b2a818f-fb58-45f6-a686-c545cf57d0c6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:12.831046 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4b2a818f-fb58-45f6-a686-c545cf57d0c6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:12.831825 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4b2a818f-fb58-45f6-a686-c545cf57d0c6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:12.832277 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4b2a818f-fb58-45f6-a686-c545cf57d0c6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:12.935047 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8895674f-7272-46d8-949f-28a4ff6a6691 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:12.942893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8895674f-7272-46d8-949f-28a4ff6a6691 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.150272 Jul 28 03:38:12.943666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 58/139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:12 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:12.966167 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-4b2a818f-fb58-45f6-a686-c545cf57d0c6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:12.973635 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-4b2a818f-fb58-45f6-a686-c545cf57d0c6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1317 microversion: 2.1 time: 0.155372 Jul 28 03:38:12.974185 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 82/140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:12 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:13.802371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-49f1a0f0-93ff-4d01-a413-629c7e761c93 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:13.803201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-49f1a0f0-93ff-4d01-a413-629c7e761c93 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:13.809409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49f1a0f0-93ff-4d01-a413-629c7e761c93 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:13.810158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49f1a0f0-93ff-4d01-a413-629c7e761c93 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:13.811002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49f1a0f0-93ff-4d01-a413-629c7e761c93 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:13.811431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49f1a0f0-93ff-4d01-a413-629c7e761c93 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:13.828736 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d9f3ea56-f88e-4b28-b686-36880afcee71 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:13.829742 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d9f3ea56-f88e-4b28-b686-36880afcee71 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:13.835665 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9f3ea56-f88e-4b28-b686-36880afcee71 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:13.836150 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9f3ea56-f88e-4b28-b686-36880afcee71 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:13.836921 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9f3ea56-f88e-4b28-b686-36880afcee71 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:13.837358 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9f3ea56-f88e-4b28-b686-36880afcee71 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:13.945201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-49f1a0f0-93ff-4d01-a413-629c7e761c93 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 17508 microversion: 2.1 time: 0.146295 Jul 28 03:38:13.945842 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 59/141] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:13 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 17508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:13.960247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3ccd7e09-3757-4862-890f-6a182de69c59 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:13.961022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3ccd7e09-3757-4862-890f-6a182de69c59 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:13.968776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ccd7e09-3757-4862-890f-6a182de69c59 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:13.969554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ccd7e09-3757-4862-890f-6a182de69c59 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:13.970434 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ccd7e09-3757-4862-890f-6a182de69c59 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:13.970934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ccd7e09-3757-4862-890f-6a182de69c59 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:13.978637 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d9f3ea56-f88e-4b28-b686-36880afcee71 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 17717 microversion: 2.20 time: 0.154005 Jul 28 03:38:13.979336 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 83/142] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:13 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 17717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:13.990224 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-db1b4a71-f363-411a-85c3-0895aed52d98 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:13.991064 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-db1b4a71-f363-411a-85c3-0895aed52d98 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:13.997603 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-db1b4a71-f363-411a-85c3-0895aed52d98 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:13.998052 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-db1b4a71-f363-411a-85c3-0895aed52d98 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:13.998978 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-db1b4a71-f363-411a-85c3-0895aed52d98 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:13.999260 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-db1b4a71-f363-411a-85c3-0895aed52d98 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:14.108988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3ccd7e09-3757-4862-890f-6a182de69c59 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:14.119229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3ccd7e09-3757-4862-890f-6a182de69c59 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.161425 Jul 28 03:38:14.119229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 60/143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:13 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:14.138166 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-db1b4a71-f363-411a-85c3-0895aed52d98 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:14.145291 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-db1b4a71-f363-411a-85c3-0895aed52d98 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1317 microversion: 2.1 time: 0.158866 Jul 28 03:38:14.145851 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 84/144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:13 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:14.964819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-10274c91-5238-490e-bc45-1ac3957cba80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:14.966208 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-10274c91-5238-490e-bc45-1ac3957cba80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:14.972826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10274c91-5238-490e-bc45-1ac3957cba80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:14.973282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10274c91-5238-490e-bc45-1ac3957cba80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:14.974058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10274c91-5238-490e-bc45-1ac3957cba80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:14.974492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10274c91-5238-490e-bc45-1ac3957cba80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:14.990284 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-46d4eee3-1a7b-4d9f-aa0d-504c52bf1ca9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:14.991181 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-46d4eee3-1a7b-4d9f-aa0d-504c52bf1ca9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:14.998763 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-46d4eee3-1a7b-4d9f-aa0d-504c52bf1ca9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:14.999204 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-46d4eee3-1a7b-4d9f-aa0d-504c52bf1ca9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:15.000024 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-46d4eee3-1a7b-4d9f-aa0d-504c52bf1ca9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:15.000429 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-46d4eee3-1a7b-4d9f-aa0d-504c52bf1ca9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:15.105692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-10274c91-5238-490e-bc45-1ac3957cba80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 17508 microversion: 2.1 time: 0.144636 Jul 28 03:38:15.106322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 61/145] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:14 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 17508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:15.136449 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2a14a84a-33a6-4413-8a4e-39185db28a8e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:15.137203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2a14a84a-33a6-4413-8a4e-39185db28a8e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:15.141166 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-46d4eee3-1a7b-4d9f-aa0d-504c52bf1ca9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 17744 microversion: 2.20 time: 0.154341 Jul 28 03:38:15.144983 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 85/146] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:14 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 17744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:15.145128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2a14a84a-33a6-4413-8a4e-39185db28a8e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:15.145128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2a14a84a-33a6-4413-8a4e-39185db28a8e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:15.145769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2a14a84a-33a6-4413-8a4e-39185db28a8e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:15.146195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2a14a84a-33a6-4413-8a4e-39185db28a8e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:15.163119 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d6ea3c62-1b8d-446f-9ff8-03d77950e3c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:15.163842 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d6ea3c62-1b8d-446f-9ff8-03d77950e3c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:15.170486 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d6ea3c62-1b8d-446f-9ff8-03d77950e3c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:15.170933 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d6ea3c62-1b8d-446f-9ff8-03d77950e3c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:15.171691 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d6ea3c62-1b8d-446f-9ff8-03d77950e3c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:15.172152 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d6ea3c62-1b8d-446f-9ff8-03d77950e3c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:15.302771 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d6ea3c62-1b8d-446f-9ff8-03d77950e3c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:15.304758 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2a14a84a-33a6-4413-8a4e-39185db28a8e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:15.310869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d6ea3c62-1b8d-446f-9ff8-03d77950e3c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1506 microversion: 2.1 time: 0.151739 Jul 28 03:38:15.311430 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 86/147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:15 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:15.312971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2a14a84a-33a6-4413-8a4e-39185db28a8e tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.181979 Jul 28 03:38:15.313528 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 62/148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:15 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:15.328103 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d64ce894-60e7-45bf-876d-6b4f837b30e9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ec55282-2555-4905-9457-038790dbfc38"}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:15.329279 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d64ce894-60e7-45bf-876d-6b4f837b30e9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:15.335085 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d64ce894-60e7-45bf-876d-6b4f837b30e9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:15.335535 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d64ce894-60e7-45bf-876d-6b4f837b30e9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:15.336328 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d64ce894-60e7-45bf-876d-6b4f837b30e9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:15.336756 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d64ce894-60e7-45bf-876d-6b4f837b30e9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:15.418961 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-d64ce894-60e7-45bf-876d-6b4f837b30e9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] HTTP exception thrown: Invalid volume: volume 5ec55282-2555-4905-9457-038790dbfc38 is already attached to instances: b227749a-44c6-4ab6-8c93-95345fba06ba Jul 28 03:38:15.419541 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d64ce894-60e7-45bf-876d-6b4f837b30e9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Returning 400 to user: Invalid volume: volume 5ec55282-2555-4905-9457-038790dbfc38 is already attached to instances: b227749a-44c6-4ab6-8c93-95345fba06ba {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:38:15.420388 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d64ce894-60e7-45bf-876d-6b4f837b30e9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "POST /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096231 Jul 28 03:38:15.420915 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 87/149] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 03:38:15 2021] POST /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:38:15.486863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-112f03aa-9624-4f64-ba9e-b4dfb10a6d0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:15.487357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-112f03aa-9624-4f64-ba9e-b4dfb10a6d0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:15.493027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-112f03aa-9624-4f64-ba9e-b4dfb10a6d0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:15.493475 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-112f03aa-9624-4f64-ba9e-b4dfb10a6d0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:15.494244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-112f03aa-9624-4f64-ba9e-b4dfb10a6d0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:15.494680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-112f03aa-9624-4f64-ba9e-b4dfb10a6d0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:15.626720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-112f03aa-9624-4f64-ba9e-b4dfb10a6d0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lazy-loading 'services' on Instance uuid b227749a-44c6-4ab6-8c93-95345fba06ba {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:38:15.742841 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-112f03aa-9624-4f64-ba9e-b4dfb10a6d0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba/os-volume_attachments/5ec55282-2555-4905-9457-038790dbfc38" status: 202 len: 0 microversion: 2.1 time: 0.259224 Jul 28 03:38:15.743425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 63/150] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Jul 28 03:38:15 2021] DELETE /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba/os-volume_attachments/5ec55282-2555-4905-9457-038790dbfc38 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:16.117198 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c16eedb2-a757-429f-a74a-f11d07c5e3f3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:16.119009 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c16eedb2-a757-429f-a74a-f11d07c5e3f3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:16.127411 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c16eedb2-a757-429f-a74a-f11d07c5e3f3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:16.127829 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c16eedb2-a757-429f-a74a-f11d07c5e3f3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:16.128612 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c16eedb2-a757-429f-a74a-f11d07c5e3f3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:16.129039 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c16eedb2-a757-429f-a74a-f11d07c5e3f3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:16.152872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-78a0bc60-4b6f-4b59-a87f-1654a4a485d1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:16.153855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-78a0bc60-4b6f-4b59-a87f-1654a4a485d1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:16.161015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-78a0bc60-4b6f-4b59-a87f-1654a4a485d1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:16.161718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-78a0bc60-4b6f-4b59-a87f-1654a4a485d1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:16.162702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-78a0bc60-4b6f-4b59-a87f-1654a4a485d1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:16.163336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-78a0bc60-4b6f-4b59-a87f-1654a4a485d1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:18.684083 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c16eedb2-a757-429f-a74a-f11d07c5e3f3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 23798 microversion: 2.1 time: 2.570590 Jul 28 03:38:18.684631 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 88/151] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:16 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 23798 bytes in 2572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:18.689337 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-79d9cfd5-0c9b-46f3-97b5-37600b206e6d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:18.690023 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-79d9cfd5-0c9b-46f3-97b5-37600b206e6d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:18.696353 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79d9cfd5-0c9b-46f3-97b5-37600b206e6d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:18.696795 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79d9cfd5-0c9b-46f3-97b5-37600b206e6d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:18.697552 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79d9cfd5-0c9b-46f3-97b5-37600b206e6d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:18.698009 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79d9cfd5-0c9b-46f3-97b5-37600b206e6d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:18.712554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-78a0bc60-4b6f-4b59-a87f-1654a4a485d1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 23798 microversion: 2.20 time: 2.564363 Jul 28 03:38:18.714382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 64/152] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:16 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 23798 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:18.719991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-5fee9f0f-4a8b-4d62-b17f-1e6065242c79 req-3ed30e6e-e982-4d3d-a27f-7ba9f5c045bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0275d16a-5dbd-4afc-a597-75061e247ec7", "name": "network-vif-unplugged", "status": "completed", "tag": "b3e3ec1a-8dd4-4c1a-a32d-07e3daad5d64"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:18.721456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:18.721456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:38:18.728876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5fee9f0f-4a8b-4d62-b17f-1e6065242c79 req-3ed30e6e-e982-4d3d-a27f-7ba9f5c045bf service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:18.729369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5fee9f0f-4a8b-4d62-b17f-1e6065242c79 req-3ed30e6e-e982-4d3d-a27f-7ba9f5c045bf service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:18.741228 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-5fee9f0f-4a8b-4d62-b17f-1e6065242c79 req-3ed30e6e-e982-4d3d-a27f-7ba9f5c045bf service nova] Creating event network-vif-unplugged:b3e3ec1a-8dd4-4c1a-a32d-07e3daad5d64 for instance 0275d16a-5dbd-4afc-a597-75061e247ec7 on hv-cinder-73306 Jul 28 03:38:18.746429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-5fee9f0f-4a8b-4d62-b17f-1e6065242c79 req-3ed30e6e-e982-4d3d-a27f-7ba9f5c045bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030418 Jul 28 03:38:18.747013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 65/153] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:38:18 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:18.823573 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-79d9cfd5-0c9b-46f3-97b5-37600b206e6d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:18.831459 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-79d9cfd5-0c9b-46f3-97b5-37600b206e6d tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.145734 Jul 28 03:38:18.832212 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 89/154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:18 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:19.696142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-308911d9-dc32-4898-807a-dd64992a898f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:19.697133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-308911d9-dc32-4898-807a-dd64992a898f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:19.703863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-308911d9-dc32-4898-807a-dd64992a898f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:19.704311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-308911d9-dc32-4898-807a-dd64992a898f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:19.705076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-308911d9-dc32-4898-807a-dd64992a898f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:19.705507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-308911d9-dc32-4898-807a-dd64992a898f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:19.725867 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-051393e7-121a-4b37-8519-4dfd8e1ce277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:19.726765 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-051393e7-121a-4b37-8519-4dfd8e1ce277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:19.733891 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-051393e7-121a-4b37-8519-4dfd8e1ce277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:19.734345 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-051393e7-121a-4b37-8519-4dfd8e1ce277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:19.735118 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-051393e7-121a-4b37-8519-4dfd8e1ce277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:19.735554 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-051393e7-121a-4b37-8519-4dfd8e1ce277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:19.854911 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-308911d9-dc32-4898-807a-dd64992a898f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 24882 microversion: 2.1 time: 0.161992 Jul 28 03:38:19.856353 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 66/155] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:19 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 24882 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:19.860592 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-30c6e3c1-9b4c-4f5f-8007-1f8295d1d5f8 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:19.861291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-30c6e3c1-9b4c-4f5f-8007-1f8295d1d5f8 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:19.867690 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30c6e3c1-9b4c-4f5f-8007-1f8295d1d5f8 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:19.868173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30c6e3c1-9b4c-4f5f-8007-1f8295d1d5f8 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:19.868937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30c6e3c1-9b4c-4f5f-8007-1f8295d1d5f8 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:19.869369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30c6e3c1-9b4c-4f5f-8007-1f8295d1d5f8 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:19.893594 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-051393e7-121a-4b37-8519-4dfd8e1ce277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 24902 microversion: 2.20 time: 0.171302 Jul 28 03:38:19.897672 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 90/156] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:19 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 24902 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:20.003320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-30c6e3c1-9b4c-4f5f-8007-1f8295d1d5f8 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:20.011054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-30c6e3c1-9b4c-4f5f-8007-1f8295d1d5f8 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.154170 Jul 28 03:38:20.011605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 67/157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:19 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:20.866644 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ff031bea-1778-4a9e-8008-4e9f9ff96639 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:20.867657 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ff031bea-1778-4a9e-8008-4e9f9ff96639 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:20.874183 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff031bea-1778-4a9e-8008-4e9f9ff96639 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:20.874627 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff031bea-1778-4a9e-8008-4e9f9ff96639 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:20.875391 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff031bea-1778-4a9e-8008-4e9f9ff96639 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:20.875854 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff031bea-1778-4a9e-8008-4e9f9ff96639 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:20.905820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-556fbcbe-1943-4d22-9c86-569b1a860b20 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:20.906820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-556fbcbe-1943-4d22-9c86-569b1a860b20 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:20.912990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-556fbcbe-1943-4d22-9c86-569b1a860b20 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:20.913516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-556fbcbe-1943-4d22-9c86-569b1a860b20 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:20.914285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-556fbcbe-1943-4d22-9c86-569b1a860b20 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:20.914715 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-556fbcbe-1943-4d22-9c86-569b1a860b20 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:21.000141 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ff031bea-1778-4a9e-8008-4e9f9ff96639 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 25704 microversion: 2.1 time: 0.136970 Jul 28 03:38:21.000853 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 91/158] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:20 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 25704 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:21.027824 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d5d643d7-08cc-4cfa-9c1b-d1844fcd0aa0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:21.028847 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d5d643d7-08cc-4cfa-9c1b-d1844fcd0aa0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:21.035225 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5d643d7-08cc-4cfa-9c1b-d1844fcd0aa0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:21.035667 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5d643d7-08cc-4cfa-9c1b-d1844fcd0aa0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:21.036461 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5d643d7-08cc-4cfa-9c1b-d1844fcd0aa0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:21.036882 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5d643d7-08cc-4cfa-9c1b-d1844fcd0aa0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:21.040677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-556fbcbe-1943-4d22-9c86-569b1a860b20 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 25972 microversion: 2.20 time: 0.139110 Jul 28 03:38:21.041574 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 68/159] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:20 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 25972 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:21.160898 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d5d643d7-08cc-4cfa-9c1b-d1844fcd0aa0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:21.168625 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d5d643d7-08cc-4cfa-9c1b-d1844fcd0aa0 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.145461 Jul 28 03:38:21.169186 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 92/160] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:21 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:22.012119 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b78a697f-a1c0-43e5-b35c-da81769868bf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:22.013225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b78a697f-a1c0-43e5-b35c-da81769868bf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:22.019628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b78a697f-a1c0-43e5-b35c-da81769868bf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:22.020110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b78a697f-a1c0-43e5-b35c-da81769868bf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:22.020867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b78a697f-a1c0-43e5-b35c-da81769868bf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:22.021300 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b78a697f-a1c0-43e5-b35c-da81769868bf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:22.052873 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-45e93ff2-e37f-49f0-8dd7-862644948393 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:22.053780 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-45e93ff2-e37f-49f0-8dd7-862644948393 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:22.060165 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45e93ff2-e37f-49f0-8dd7-862644948393 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:22.060675 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45e93ff2-e37f-49f0-8dd7-862644948393 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:22.061448 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45e93ff2-e37f-49f0-8dd7-862644948393 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:22.061884 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45e93ff2-e37f-49f0-8dd7-862644948393 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:22.186254 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b78a697f-a1c0-43e5-b35c-da81769868bf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 26551 microversion: 2.1 time: 0.178228 Jul 28 03:38:22.186886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 69/161] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:22 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 26551 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:22.191617 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4c60c44d-4897-44ce-8a1d-89d6039fd721 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:22.192339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4c60c44d-4897-44ce-8a1d-89d6039fd721 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:22.199247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c60c44d-4897-44ce-8a1d-89d6039fd721 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:22.199780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c60c44d-4897-44ce-8a1d-89d6039fd721 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:22.200550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c60c44d-4897-44ce-8a1d-89d6039fd721 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:22.200985 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c60c44d-4897-44ce-8a1d-89d6039fd721 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:22.290697 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-45e93ff2-e37f-49f0-8dd7-862644948393 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 26643 microversion: 2.20 time: 0.241411 Jul 28 03:38:22.294802 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 93/162] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:22 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 26643 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:22.323562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4c60c44d-4897-44ce-8a1d-89d6039fd721 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:22.331254 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4c60c44d-4897-44ce-8a1d-89d6039fd721 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.143275 Jul 28 03:38:22.331844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 70/163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:22 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:23.197946 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e593955c-f373-4251-8e49-d5a6485e9fe2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:23.198948 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e593955c-f373-4251-8e49-d5a6485e9fe2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:23.205230 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e593955c-f373-4251-8e49-d5a6485e9fe2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:23.205682 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e593955c-f373-4251-8e49-d5a6485e9fe2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:23.206459 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e593955c-f373-4251-8e49-d5a6485e9fe2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:23.206900 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e593955c-f373-4251-8e49-d5a6485e9fe2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:23.303536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e480e45b-3e54-46ca-a135-0a307b7a51f4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:23.304429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e480e45b-3e54-46ca-a135-0a307b7a51f4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:23.310812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e480e45b-3e54-46ca-a135-0a307b7a51f4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:23.311294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e480e45b-3e54-46ca-a135-0a307b7a51f4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:23.312245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e480e45b-3e54-46ca-a135-0a307b7a51f4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:23.312685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e480e45b-3e54-46ca-a135-0a307b7a51f4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:23.324702 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e593955c-f373-4251-8e49-d5a6485e9fe2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 27072 microversion: 2.1 time: 0.130546 Jul 28 03:38:23.325340 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 94/164] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:23 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 27072 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:23.349455 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ef07573d-1240-4dfd-a6dd-027c216d19a6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:23.350414 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ef07573d-1240-4dfd-a6dd-027c216d19a6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:23.359124 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ef07573d-1240-4dfd-a6dd-027c216d19a6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:23.359564 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ef07573d-1240-4dfd-a6dd-027c216d19a6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:23.360354 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ef07573d-1240-4dfd-a6dd-027c216d19a6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:23.360835 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ef07573d-1240-4dfd-a6dd-027c216d19a6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:23.413873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e480e45b-3e54-46ca-a135-0a307b7a51f4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 27139 microversion: 2.20 time: 0.114371 Jul 28 03:38:23.418573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 71/165] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:23 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 27139 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:23.487421 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ef07573d-1240-4dfd-a6dd-027c216d19a6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:23.495644 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ef07573d-1240-4dfd-a6dd-027c216d19a6 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.150454 Jul 28 03:38:23.496365 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 95/166] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:23 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:24.336242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cbbf6122-4ea6-4b48-8a9a-793e982b0e79 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:24.337234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cbbf6122-4ea6-4b48-8a9a-793e982b0e79 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:24.344742 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbbf6122-4ea6-4b48-8a9a-793e982b0e79 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:24.345188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbbf6122-4ea6-4b48-8a9a-793e982b0e79 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:24.345952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbbf6122-4ea6-4b48-8a9a-793e982b0e79 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:24.346382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbbf6122-4ea6-4b48-8a9a-793e982b0e79 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:24.426123 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5c8e08f8-4dae-453b-91a2-973767e7491f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:24.427031 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5c8e08f8-4dae-453b-91a2-973767e7491f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:24.433230 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5c8e08f8-4dae-453b-91a2-973767e7491f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:24.433673 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5c8e08f8-4dae-453b-91a2-973767e7491f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:24.434438 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5c8e08f8-4dae-453b-91a2-973767e7491f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:24.434874 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5c8e08f8-4dae-453b-91a2-973767e7491f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:26.481192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cbbf6122-4ea6-4b48-8a9a-793e982b0e79 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 27874 microversion: 2.1 time: 2.148757 Jul 28 03:38:26.481836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 72/167] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:24 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 27874 bytes in 2150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:26.486720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9152b72e-b3d4-4ed7-9bfc-89f0314c5f5b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:26.487442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9152b72e-b3d4-4ed7-9bfc-89f0314c5f5b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:26.493787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9152b72e-b3d4-4ed7-9bfc-89f0314c5f5b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:26.494239 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9152b72e-b3d4-4ed7-9bfc-89f0314c5f5b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:26.495738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9152b72e-b3d4-4ed7-9bfc-89f0314c5f5b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:26.496179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9152b72e-b3d4-4ed7-9bfc-89f0314c5f5b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:26.507700 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5c8e08f8-4dae-453b-91a2-973767e7491f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 27805 microversion: 2.20 time: 2.085006 Jul 28 03:38:26.512278 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 96/168] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:24 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 27805 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:26.618642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9152b72e-b3d4-4ed7-9bfc-89f0314c5f5b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:26.627885 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9152b72e-b3d4-4ed7-9bfc-89f0314c5f5b tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1553 microversion: 2.1 time: 0.144715 Jul 28 03:38:26.628644 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 73/169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:26 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:27.199139 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-36f4d408-18ca-47ee-9b01-08a133375d7e req-c946c536-c0e5-49b0-acb8-41737b9fd15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0275d16a-5dbd-4afc-a597-75061e247ec7", "name": "network-vif-deleted", "tag": "b3e3ec1a-8dd4-4c1a-a32d-07e3daad5d64"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:27.200656 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:27.200656 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:38:27.208725 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-36f4d408-18ca-47ee-9b01-08a133375d7e req-c946c536-c0e5-49b0-acb8-41737b9fd15d service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:27.209187 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-36f4d408-18ca-47ee-9b01-08a133375d7e req-c946c536-c0e5-49b0-acb8-41737b9fd15d service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:27.220445 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-36f4d408-18ca-47ee-9b01-08a133375d7e req-c946c536-c0e5-49b0-acb8-41737b9fd15d service nova] Creating event network-vif-deleted:b3e3ec1a-8dd4-4c1a-a32d-07e3daad5d64 for instance 0275d16a-5dbd-4afc-a597-75061e247ec7 on hv-cinder-73306 Jul 28 03:38:27.225001 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-36f4d408-18ca-47ee-9b01-08a133375d7e req-c946c536-c0e5-49b0-acb8-41737b9fd15d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030509 Jul 28 03:38:27.225582 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 97/170] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:38:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:27.492702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-77e57a55-ff06-4c83-b4aa-18569f24cbee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:27.493527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-77e57a55-ff06-4c83-b4aa-18569f24cbee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:27.499896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77e57a55-ff06-4c83-b4aa-18569f24cbee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:27.500345 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77e57a55-ff06-4c83-b4aa-18569f24cbee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:27.501118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77e57a55-ff06-4c83-b4aa-18569f24cbee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:27.501555 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77e57a55-ff06-4c83-b4aa-18569f24cbee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:27.520556 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-6b534589-1be7-46cd-9356-6decd76f1167 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:27.521547 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-6b534589-1be7-46cd-9356-6decd76f1167 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:27.528124 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6b534589-1be7-46cd-9356-6decd76f1167 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:27.528577 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6b534589-1be7-46cd-9356-6decd76f1167 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:27.529392 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6b534589-1be7-46cd-9356-6decd76f1167 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:27.529821 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6b534589-1be7-46cd-9356-6decd76f1167 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:27.633549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-77e57a55-ff06-4c83-b4aa-18569f24cbee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28233 microversion: 2.1 time: 0.144464 Jul 28 03:38:27.634212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 74/171] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:27 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28233 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:27.645139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2db55806-adc5-4a03-9006-6248df9fb279 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:27.645837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2db55806-adc5-4a03-9006-6248df9fb279 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:27.652897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2db55806-adc5-4a03-9006-6248df9fb279 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:27.653344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2db55806-adc5-4a03-9006-6248df9fb279 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:27.654102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2db55806-adc5-4a03-9006-6248df9fb279 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:27.654537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2db55806-adc5-4a03-9006-6248df9fb279 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:27.663922 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-6b534589-1be7-46cd-9356-6decd76f1167 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28164 microversion: 2.20 time: 0.147148 Jul 28 03:38:27.667848 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 98/172] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:27 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28164 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:27.716042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2db55806-adc5-4a03-9006-6248df9fb279 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:27.723921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2db55806-adc5-4a03-9006-6248df9fb279 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1345 microversion: 2.1 time: 0.082568 Jul 28 03:38:27.724473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 75/173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:27 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:28.646216 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5cda6b96-c43f-477b-84a6-bfe790cc8a6b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:28.647203 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5cda6b96-c43f-477b-84a6-bfe790cc8a6b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:28.654269 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cda6b96-c43f-477b-84a6-bfe790cc8a6b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:28.654710 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cda6b96-c43f-477b-84a6-bfe790cc8a6b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:28.655464 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cda6b96-c43f-477b-84a6-bfe790cc8a6b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:28.655938 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cda6b96-c43f-477b-84a6-bfe790cc8a6b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:28.675420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5a34e5b0-499e-4001-88c6-1959e3201396 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:28.676391 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5a34e5b0-499e-4001-88c6-1959e3201396 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:28.683319 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a34e5b0-499e-4001-88c6-1959e3201396 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:28.683783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a34e5b0-499e-4001-88c6-1959e3201396 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:28.684622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a34e5b0-499e-4001-88c6-1959e3201396 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:28.685060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a34e5b0-499e-4001-88c6-1959e3201396 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:30.695533 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5cda6b96-c43f-477b-84a6-bfe790cc8a6b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28233 microversion: 2.1 time: 2.053191 Jul 28 03:38:30.696224 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 99/174] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:28 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28233 bytes in 2055 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:30.701212 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e228f03b-41e0-4e84-a492-ad7b9134794a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:30.701898 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e228f03b-41e0-4e84-a492-ad7b9134794a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:30.708281 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e228f03b-41e0-4e84-a492-ad7b9134794a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:30.708725 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e228f03b-41e0-4e84-a492-ad7b9134794a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:30.709484 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e228f03b-41e0-4e84-a492-ad7b9134794a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:30.709916 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e228f03b-41e0-4e84-a492-ad7b9134794a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:30.760140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5a34e5b0-499e-4001-88c6-1959e3201396 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28164 microversion: 2.20 time: 2.088203 Jul 28 03:38:30.761103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 76/175] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:28 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28164 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:30.769925 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e228f03b-41e0-4e84-a492-ad7b9134794a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:30.778317 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e228f03b-41e0-4e84-a492-ad7b9134794a tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1345 microversion: 2.1 time: 0.080816 Jul 28 03:38:30.778864 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 100/176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:30 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:31.317400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-988570421", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "networks": [{"uuid": "907c8c72-fbe1-4216-965a-39395c1cad68"}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:31.403980 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] validate_networks() for [('907c8c72-fbe1-4216-965a-39395c1cad68', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:38:31.708371 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-261aca16-3f77-4d56-affb-408a6405fae9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:31.709406 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-261aca16-3f77-4d56-affb-408a6405fae9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:31.720702 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-261aca16-3f77-4d56-affb-408a6405fae9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:31.721173 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-261aca16-3f77-4d56-affb-408a6405fae9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:31.721956 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-261aca16-3f77-4d56-affb-408a6405fae9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:31.722392 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-261aca16-3f77-4d56-affb-408a6405fae9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:31.838484 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-261aca16-3f77-4d56-affb-408a6405fae9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28233 microversion: 2.1 time: 0.134422 Jul 28 03:38:31.840499 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 101/177] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:31 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28233 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:31.846532 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e2d83e79-0d6e-4690-945d-32e2ba20af55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:31.847767 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e2d83e79-0d6e-4690-945d-32e2ba20af55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:31.855700 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e2d83e79-0d6e-4690-945d-32e2ba20af55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:31.856114 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e2d83e79-0d6e-4690-945d-32e2ba20af55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:31.856911 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e2d83e79-0d6e-4690-945d-32e2ba20af55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:31.857520 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e2d83e79-0d6e-4690-945d-32e2ba20af55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:31.894309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:38:31.894960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:38:31.895473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:38:31.895976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:38:31.897187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:38:31.907693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:31.908168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:31.908959 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:31.909389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:31.928458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Getting quotas for project da239fd2931445e6be6459a0225fbd85. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:38:31.933899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Getting quotas for user f3ecf43d42c74783a82bf45afd8826e8 and project da239fd2931445e6be6459a0225fbd85. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:38:31.954512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:38:31.957524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:38:31.958568 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e2d83e79-0d6e-4690-945d-32e2ba20af55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28164 microversion: 2.20 time: 0.116050 Jul 28 03:38:31.959631 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 102/178] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:31 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28164 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:31.968942 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:31.969834 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:31.990740 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:31.994177 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:31.996988 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:31.997472 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:32.034933 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:32.035408 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:32.035932 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.objects.instance [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lazy-loading 'fault' on Instance uuid 0275d16a-5dbd-4afc-a597-75061e247ec7 {{(pid=119155) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:38:32.043122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-98e9b770-74d8-4abd-a44e-1cfa04c42319 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729115 Jul 28 03:38:32.045153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 77/179] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:38:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:38:32.058555 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-89710415-aafa-4c98-a0a6-4691a6afaddb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:32.060039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-89710415-aafa-4c98-a0a6-4691a6afaddb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:32.121185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-89710415-aafa-4c98-a0a6-4691a6afaddb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:32.122891 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17af4a654a6843e5a04c396917f60365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e3e648ccf87421d9660e75180c946bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:32.131390 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-62a15b3b-aa83-4934-bed5-00454f45ffb9 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 200 len: 1304 microversion: 2.1 time: 0.170512 Jul 28 03:38:32.132029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-89710415-aafa-4c98-a0a6-4691a6afaddb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1217 microversion: 2.1 time: 0.079360 Jul 28 03:38:32.132512 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 103/180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:31 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:32.132707 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 78/181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:32 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:32.850962 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fee50f10-f449-4444-9a88-e55ea8a53345 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:32.852007 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-fee50f10-f449-4444-9a88-e55ea8a53345 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:32.858883 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fee50f10-f449-4444-9a88-e55ea8a53345 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:32.859323 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fee50f10-f449-4444-9a88-e55ea8a53345 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:32.860142 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fee50f10-f449-4444-9a88-e55ea8a53345 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:32.860564 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fee50f10-f449-4444-9a88-e55ea8a53345 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:32.970890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a139a59d-0c6b-40db-a8b4-c1a123503967 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:32.972560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a139a59d-0c6b-40db-a8b4-c1a123503967 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:32.982857 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a139a59d-0c6b-40db-a8b4-c1a123503967 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:32.983631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a139a59d-0c6b-40db-a8b4-c1a123503967 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:32.984769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a139a59d-0c6b-40db-a8b4-c1a123503967 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:32.985468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a139a59d-0c6b-40db-a8b4-c1a123503967 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:33.000262 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-fee50f10-f449-4444-9a88-e55ea8a53345 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28233 microversion: 2.1 time: 0.152803 Jul 28 03:38:33.001992 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 104/182] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:32 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28233 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:33.120023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a139a59d-0c6b-40db-a8b4-c1a123503967 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28338 microversion: 2.20 time: 0.152424 Jul 28 03:38:33.129230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 79/183] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:32 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28338 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:33.151424 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8c5fd37f-c193-4ceb-879f-8b6498bfb9eb tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:33.157263 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8c5fd37f-c193-4ceb-879f-8b6498bfb9eb tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:33.161587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ad18ac43-6152-4adb-a9f9-4b2ebff2fe40 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:33.164834 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8c5fd37f-c193-4ceb-879f-8b6498bfb9eb tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:33.165277 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8c5fd37f-c193-4ceb-879f-8b6498bfb9eb tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:33.166052 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8c5fd37f-c193-4ceb-879f-8b6498bfb9eb tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:33.166566 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8c5fd37f-c193-4ceb-879f-8b6498bfb9eb tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:33.171373 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ad18ac43-6152-4adb-a9f9-4b2ebff2fe40 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:33.179778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad18ac43-6152-4adb-a9f9-4b2ebff2fe40 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:33.180433 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad18ac43-6152-4adb-a9f9-4b2ebff2fe40 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:33.181340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad18ac43-6152-4adb-a9f9-4b2ebff2fe40 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:33.181756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad18ac43-6152-4adb-a9f9-4b2ebff2fe40 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:33.193603 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-8c5fd37f-c193-4ceb-879f-8b6498bfb9eb tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] HTTP exception thrown: Instance 0275d16a-5dbd-4afc-a597-75061e247ec7 could not be found. Jul 28 03:38:33.195167 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8c5fd37f-c193-4ceb-879f-8b6498bfb9eb tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Returning 404 to user: Instance 0275d16a-5dbd-4afc-a597-75061e247ec7 could not be found. {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:38:33.196142 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8c5fd37f-c193-4ceb-879f-8b6498bfb9eb tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 404 len: 111 microversion: 2.1 time: 0.048937 Jul 28 03:38:33.196832 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 105/184] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:33 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:38:33.261654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ad18ac43-6152-4adb-a9f9-4b2ebff2fe40 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:33.272028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ad18ac43-6152-4adb-a9f9-4b2ebff2fe40 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1269 microversion: 2.1 time: 0.117927 Jul 28 03:38:33.273118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 80/185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:33 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:34.013897 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1af14aca-3c18-4937-ab2d-0ec5bcc28285 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:34.014891 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1af14aca-3c18-4937-ab2d-0ec5bcc28285 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:34.022953 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1af14aca-3c18-4937-ab2d-0ec5bcc28285 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:34.023437 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1af14aca-3c18-4937-ab2d-0ec5bcc28285 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:34.024301 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1af14aca-3c18-4937-ab2d-0ec5bcc28285 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:34.024842 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1af14aca-3c18-4937-ab2d-0ec5bcc28285 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:34.136533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-17ce5139-1811-42c2-b4d4-f9fa319a53b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:34.137466 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-17ce5139-1811-42c2-b4d4-f9fa319a53b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:34.147142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17ce5139-1811-42c2-b4d4-f9fa319a53b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:34.148047 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17ce5139-1811-42c2-b4d4-f9fa319a53b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:34.153045 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1af14aca-3c18-4937-ab2d-0ec5bcc28285 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28519 microversion: 2.1 time: 0.144674 Jul 28 03:38:34.154478 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 106/186] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:34 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:34.155919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17ce5139-1811-42c2-b4d4-f9fa319a53b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:34.156700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17ce5139-1811-42c2-b4d4-f9fa319a53b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:34.293002 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0c0c963d-370c-43cb-bee2-94457d9ea1ad tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:34.293743 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0c0c963d-370c-43cb-bee2-94457d9ea1ad tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:34.294002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-17ce5139-1811-42c2-b4d4-f9fa319a53b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28452 microversion: 2.20 time: 0.161229 Jul 28 03:38:34.294888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 81/187] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:34 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:34.303864 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0c0c963d-370c-43cb-bee2-94457d9ea1ad tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:34.304327 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0c0c963d-370c-43cb-bee2-94457d9ea1ad tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:34.306542 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0c0c963d-370c-43cb-bee2-94457d9ea1ad tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:34.306986 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0c0c963d-370c-43cb-bee2-94457d9ea1ad tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:34.531199 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0c0c963d-370c-43cb-bee2-94457d9ea1ad tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:34.539515 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0c0c963d-370c-43cb-bee2-94457d9ea1ad tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1317 microversion: 2.1 time: 0.252369 Jul 28 03:38:34.540362 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 107/188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:34 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:34.603275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dd6d521d-a109-4c09-b900-7c8ab3b81d47 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:34.603956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dd6d521d-a109-4c09-b900-7c8ab3b81d47 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:34.612406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd6d521d-a109-4c09-b900-7c8ab3b81d47 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:34.613204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd6d521d-a109-4c09-b900-7c8ab3b81d47 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:34.614212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd6d521d-a109-4c09-b900-7c8ab3b81d47 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:34.615483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd6d521d-a109-4c09-b900-7c8ab3b81d47 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:34.640626 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-dd6d521d-a109-4c09-b900-7c8ab3b81d47 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] HTTP exception thrown: Instance 0275d16a-5dbd-4afc-a597-75061e247ec7 could not be found. Jul 28 03:38:34.641549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dd6d521d-a109-4c09-b900-7c8ab3b81d47 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Returning 404 to user: Instance 0275d16a-5dbd-4afc-a597-75061e247ec7 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:38:34.643830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dd6d521d-a109-4c09-b900-7c8ab3b81d47 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 404 len: 111 microversion: 2.1 time: 0.043228 Jul 28 03:38:34.644403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 82/189] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:38:34 2021] DELETE /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:38:34.653689 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-79be7b59-3867-474c-9d7e-7b54aa991466 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:34.654466 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-79be7b59-3867-474c-9d7e-7b54aa991466 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] [instance: 0275d16a-5dbd-4afc-a597-75061e247ec7] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:34.660743 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79be7b59-3867-474c-9d7e-7b54aa991466 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:34.661200 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79be7b59-3867-474c-9d7e-7b54aa991466 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:34.662224 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79be7b59-3867-474c-9d7e-7b54aa991466 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:34.662863 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79be7b59-3867-474c-9d7e-7b54aa991466 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:34.681749 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-79be7b59-3867-474c-9d7e-7b54aa991466 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] HTTP exception thrown: Instance 0275d16a-5dbd-4afc-a597-75061e247ec7 could not be found. Jul 28 03:38:34.683294 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-79be7b59-3867-474c-9d7e-7b54aa991466 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] Returning 404 to user: Instance 0275d16a-5dbd-4afc-a597-75061e247ec7 could not be found. {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:38:34.684871 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-79be7b59-3867-474c-9d7e-7b54aa991466 tempest-DeleteServersTestJSON-1053654091 tempest-DeleteServersTestJSON-1053654091-project] 10.222.0.16 "GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7" status: 404 len: 111 microversion: 2.1 time: 0.036265 Jul 28 03:38:34.685919 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 108/190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:34 2021] GET /compute/v2.1/servers/0275d16a-5dbd-4afc-a597-75061e247ec7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:38:35.179601 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-45749fbf-2b82-498e-8e9f-d03c53de9937 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:35.180994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-45749fbf-2b82-498e-8e9f-d03c53de9937 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:35.190479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45749fbf-2b82-498e-8e9f-d03c53de9937 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:35.191394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45749fbf-2b82-498e-8e9f-d03c53de9937 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:35.192279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45749fbf-2b82-498e-8e9f-d03c53de9937 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:35.193464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45749fbf-2b82-498e-8e9f-d03c53de9937 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:35.310449 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8ad0e924-36dc-4294-bd04-e063528397b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:35.311674 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8ad0e924-36dc-4294-bd04-e063528397b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:35.336083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-45749fbf-2b82-498e-8e9f-d03c53de9937 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28586 microversion: 2.1 time: 0.173603 Jul 28 03:38:35.339446 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8ad0e924-36dc-4294-bd04-e063528397b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:35.341910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 83/191] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:35 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28586 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:35.343007 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8ad0e924-36dc-4294-bd04-e063528397b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:35.345871 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8ad0e924-36dc-4294-bd04-e063528397b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:35.347025 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8ad0e924-36dc-4294-bd04-e063528397b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:35.489949 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8ad0e924-36dc-4294-bd04-e063528397b7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28620 microversion: 2.20 time: 0.187329 Jul 28 03:38:35.492341 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 109/192] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:35 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28620 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:35.563255 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-16f93a47-8977-40f5-8d6c-de1221c0aeb6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:35.564963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-16f93a47-8977-40f5-8d6c-de1221c0aeb6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:35.572281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16f93a47-8977-40f5-8d6c-de1221c0aeb6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:35.573487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16f93a47-8977-40f5-8d6c-de1221c0aeb6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:35.574654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16f93a47-8977-40f5-8d6c-de1221c0aeb6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:35.575319 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16f93a47-8977-40f5-8d6c-de1221c0aeb6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:35.863596 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-d773e2ec-8c6a-4e03-a0e9-8bcf2112f210 req-a9e64dce-f6d9-41db-bdc6-bb63672a638c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4063b183-9e13-41da-9c3d-66ad0e28d877", "tag": "89207e90-606c-4b3a-ac81-aead843125ef"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:35.865229 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:35.865229 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:38:35.881617 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-d773e2ec-8c6a-4e03-a0e9-8bcf2112f210 req-a9e64dce-f6d9-41db-bdc6-bb63672a638c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:35.883255 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-d773e2ec-8c6a-4e03-a0e9-8bcf2112f210 req-a9e64dce-f6d9-41db-bdc6-bb63672a638c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:35.913866 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-d773e2ec-8c6a-4e03-a0e9-8bcf2112f210 req-a9e64dce-f6d9-41db-bdc6-bb63672a638c service nova] Creating event network-changed:89207e90-606c-4b3a-ac81-aead843125ef for instance 4063b183-9e13-41da-9c3d-66ad0e28d877 on hv-cinder-73306 Jul 28 03:38:35.927952 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-d773e2ec-8c6a-4e03-a0e9-8bcf2112f210 req-a9e64dce-f6d9-41db-bdc6-bb63672a638c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064803 Jul 28 03:38:35.930528 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 110/193] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:38:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:35.996262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-16f93a47-8977-40f5-8d6c-de1221c0aeb6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:36.005026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-16f93a47-8977-40f5-8d6c-de1221c0aeb6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1317 microversion: 2.1 time: 0.447790 Jul 28 03:38:36.006534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 84/194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:35 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:36.359155 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-132072fe-7307-49f6-8b76-9e43a4d2f7ba tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:36.361950 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-132072fe-7307-49f6-8b76-9e43a4d2f7ba tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:36.405509 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-132072fe-7307-49f6-8b76-9e43a4d2f7ba tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:36.406699 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-132072fe-7307-49f6-8b76-9e43a4d2f7ba tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:36.409165 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-132072fe-7307-49f6-8b76-9e43a4d2f7ba tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:36.410771 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-132072fe-7307-49f6-8b76-9e43a4d2f7ba tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:36.504330 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-de594839-5f87-4686-a397-59c0c2955cc0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:36.505255 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-de594839-5f87-4686-a397-59c0c2955cc0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:36.514170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de594839-5f87-4686-a397-59c0c2955cc0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:36.516317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de594839-5f87-4686-a397-59c0c2955cc0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:36.517934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de594839-5f87-4686-a397-59c0c2955cc0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:36.518677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de594839-5f87-4686-a397-59c0c2955cc0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:36.548067 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-132072fe-7307-49f6-8b76-9e43a4d2f7ba tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28686 microversion: 2.1 time: 0.197212 Jul 28 03:38:36.549301 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 111/195] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:36 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28686 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:36.703106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-de594839-5f87-4686-a397-59c0c2955cc0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28620 microversion: 2.20 time: 0.203045 Jul 28 03:38:36.704667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 85/196] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:36 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28620 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:37.024929 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-39882444-3ee4-4986-bb8a-bdea3d8ae7ee tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:37.026189 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-39882444-3ee4-4986-bb8a-bdea3d8ae7ee tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:37.045868 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-39882444-3ee4-4986-bb8a-bdea3d8ae7ee tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:37.046417 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-39882444-3ee4-4986-bb8a-bdea3d8ae7ee tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:37.047284 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-39882444-3ee4-4986-bb8a-bdea3d8ae7ee tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:37.047837 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-39882444-3ee4-4986-bb8a-bdea3d8ae7ee tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:37.240894 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-39882444-3ee4-4986-bb8a-bdea3d8ae7ee tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:37.250006 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-39882444-3ee4-4986-bb8a-bdea3d8ae7ee tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1317 microversion: 2.1 time: 0.230030 Jul 28 03:38:37.260631 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 112/197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:37 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:37.560325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4c1f1b34-1cbb-4a20-b6c5-424d37d5457d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:37.561507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4c1f1b34-1cbb-4a20-b6c5-424d37d5457d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:37.567635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c1f1b34-1cbb-4a20-b6c5-424d37d5457d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:37.568109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c1f1b34-1cbb-4a20-b6c5-424d37d5457d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:37.568881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c1f1b34-1cbb-4a20-b6c5-424d37d5457d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:37.569316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c1f1b34-1cbb-4a20-b6c5-424d37d5457d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:37.681335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4c1f1b34-1cbb-4a20-b6c5-424d37d5457d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28686 microversion: 2.1 time: 0.125163 Jul 28 03:38:37.682751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 86/198] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:37 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28686 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:37.715229 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-108b61c1-b832-461e-beb4-18f2633b065e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:37.716353 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-108b61c1-b832-461e-beb4-18f2633b065e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:37.722864 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-108b61c1-b832-461e-beb4-18f2633b065e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:37.723848 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-108b61c1-b832-461e-beb4-18f2633b065e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:37.724763 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-108b61c1-b832-461e-beb4-18f2633b065e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:37.725226 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-108b61c1-b832-461e-beb4-18f2633b065e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:37.840397 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-108b61c1-b832-461e-beb4-18f2633b065e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28620 microversion: 2.20 time: 0.129145 Jul 28 03:38:37.841274 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 113/199] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:37 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28620 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:38.269184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2c1b3f17-3ce2-4c22-bc58-2fa4e6284562 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:38.270295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2c1b3f17-3ce2-4c22-bc58-2fa4e6284562 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:38.279447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c1b3f17-3ce2-4c22-bc58-2fa4e6284562 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:38.280282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c1b3f17-3ce2-4c22-bc58-2fa4e6284562 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:38.282011 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c1b3f17-3ce2-4c22-bc58-2fa4e6284562 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:38.283184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c1b3f17-3ce2-4c22-bc58-2fa4e6284562 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:38.533214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2c1b3f17-3ce2-4c22-bc58-2fa4e6284562 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:38.549391 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2c1b3f17-3ce2-4c22-bc58-2fa4e6284562 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1317 microversion: 2.1 time: 0.284597 Jul 28 03:38:38.549969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 87/200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:38 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:38.696498 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-47f25dba-c546-4caf-98d7-e4ba7da5f98f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:38.698245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-47f25dba-c546-4caf-98d7-e4ba7da5f98f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:38.705326 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47f25dba-c546-4caf-98d7-e4ba7da5f98f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:38.705954 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47f25dba-c546-4caf-98d7-e4ba7da5f98f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:38.706782 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47f25dba-c546-4caf-98d7-e4ba7da5f98f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:38.707208 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47f25dba-c546-4caf-98d7-e4ba7da5f98f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:38.812463 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-47f25dba-c546-4caf-98d7-e4ba7da5f98f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28686 microversion: 2.1 time: 0.119596 Jul 28 03:38:38.820763 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 114/201] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:38 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28686 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:38.852393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-99e4b0bf-0b88-4767-bb77-7b1ef48309cc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:38.853297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-99e4b0bf-0b88-4767-bb77-7b1ef48309cc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:38.862389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99e4b0bf-0b88-4767-bb77-7b1ef48309cc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:38.865098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99e4b0bf-0b88-4767-bb77-7b1ef48309cc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:38.865894 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99e4b0bf-0b88-4767-bb77-7b1ef48309cc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:38.866328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99e4b0bf-0b88-4767-bb77-7b1ef48309cc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:38.975880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-99e4b0bf-0b88-4767-bb77-7b1ef48309cc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28620 microversion: 2.20 time: 0.126467 Jul 28 03:38:38.976819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 88/202] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:38 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28620 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:39.566947 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0144f677-e494-4e36-a515-8b3578c94d18 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:39.567636 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0144f677-e494-4e36-a515-8b3578c94d18 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:39.574027 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0144f677-e494-4e36-a515-8b3578c94d18 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:39.580814 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0144f677-e494-4e36-a515-8b3578c94d18 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:39.582142 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0144f677-e494-4e36-a515-8b3578c94d18 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:39.582719 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0144f677-e494-4e36-a515-8b3578c94d18 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:39.828343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5304455c-3fbf-4aca-949f-92b9ec07a4bb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:39.829338 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5304455c-3fbf-4aca-949f-92b9ec07a4bb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:39.835837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5304455c-3fbf-4aca-949f-92b9ec07a4bb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:39.836854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5304455c-3fbf-4aca-949f-92b9ec07a4bb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:39.837844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5304455c-3fbf-4aca-949f-92b9ec07a4bb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:39.839162 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5304455c-3fbf-4aca-949f-92b9ec07a4bb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:39.858188 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0144f677-e494-4e36-a515-8b3578c94d18 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:39.873000 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0144f677-e494-4e36-a515-8b3578c94d18 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1317 microversion: 2.1 time: 0.309750 Jul 28 03:38:39.875763 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 115/203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:39 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:39.935110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5304455c-3fbf-4aca-949f-92b9ec07a4bb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28686 microversion: 2.1 time: 0.110347 Jul 28 03:38:39.935789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 89/204] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:39 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28686 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:38:39.990280 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-28ecebba-2079-457b-b10f-4bffa3b72b48 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:39.991635 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-28ecebba-2079-457b-b10f-4bffa3b72b48 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:39.997666 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-28ecebba-2079-457b-b10f-4bffa3b72b48 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:39.998113 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-28ecebba-2079-457b-b10f-4bffa3b72b48 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:39.999056 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-28ecebba-2079-457b-b10f-4bffa3b72b48 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:39.999642 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-28ecebba-2079-457b-b10f-4bffa3b72b48 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:40.104264 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-28ecebba-2079-457b-b10f-4bffa3b72b48 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28620 microversion: 2.20 time: 0.118434 Jul 28 03:38:40.106104 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 116/205] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:39 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28620 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:40.890793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-de7e5d08-f3a1-4265-acc5-b369a5c6a1d8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:40.891481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-de7e5d08-f3a1-4265-acc5-b369a5c6a1d8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:40.898049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de7e5d08-f3a1-4265-acc5-b369a5c6a1d8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:40.898489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de7e5d08-f3a1-4265-acc5-b369a5c6a1d8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:40.899243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de7e5d08-f3a1-4265-acc5-b369a5c6a1d8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:40.899668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de7e5d08-f3a1-4265-acc5-b369a5c6a1d8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:40.946883 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-bba721dc-9c2c-4cf3-909e-591e1b85ad57 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:40.948029 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-bba721dc-9c2c-4cf3-909e-591e1b85ad57 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:40.957535 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bba721dc-9c2c-4cf3-909e-591e1b85ad57 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:40.960770 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bba721dc-9c2c-4cf3-909e-591e1b85ad57 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:40.961736 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bba721dc-9c2c-4cf3-909e-591e1b85ad57 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:40.963183 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bba721dc-9c2c-4cf3-909e-591e1b85ad57 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:41.050359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-de7e5d08-f3a1-4265-acc5-b369a5c6a1d8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:41.059430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-de7e5d08-f3a1-4265-acc5-b369a5c6a1d8 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1317 microversion: 2.1 time: 0.172547 Jul 28 03:38:41.068785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 90/206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:40 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:41.122213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cf046ebb-a849-4a8d-8ef0-42de232a734e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:41.127508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cf046ebb-a849-4a8d-8ef0-42de232a734e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:41.133817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf046ebb-a849-4a8d-8ef0-42de232a734e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:41.134276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf046ebb-a849-4a8d-8ef0-42de232a734e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:41.135060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf046ebb-a849-4a8d-8ef0-42de232a734e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:41.135654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf046ebb-a849-4a8d-8ef0-42de232a734e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:43.019012 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-bba721dc-9c2c-4cf3-909e-591e1b85ad57 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 28686 microversion: 2.1 time: 2.075840 Jul 28 03:38:43.019578 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 117/207] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:40 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 28686 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:38:43.025329 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-548fff7b-b0d9-4cb7-890a-27d6fc95e083 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:43.026788 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-548fff7b-b0d9-4cb7-890a-27d6fc95e083 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:43.033657 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-548fff7b-b0d9-4cb7-890a-27d6fc95e083 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:43.034343 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-548fff7b-b0d9-4cb7-890a-27d6fc95e083 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:43.035115 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-548fff7b-b0d9-4cb7-890a-27d6fc95e083 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:43.035544 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-548fff7b-b0d9-4cb7-890a-27d6fc95e083 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:43.045829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cf046ebb-a849-4a8d-8ef0-42de232a734e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 28620 microversion: 2.20 time: 1.928267 Jul 28 03:38:43.046472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 91/208] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:41 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 28620 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:43.175234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-15908918", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a08c665d-fc97-4225-bb45-ecd81a76a165"}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:43.180828 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-548fff7b-b0d9-4cb7-890a-27d6fc95e083 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:43.188950 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-548fff7b-b0d9-4cb7-890a-27d6fc95e083 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1317 microversion: 2.1 time: 0.168036 Jul 28 03:38:43.189787 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 118/209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:43 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:43.237151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] validate_networks() for [('a08c665d-fc97-4225-bb45-ecd81a76a165', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:38:43.626883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:38:43.628079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:38:43.628960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:38:43.630121 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:38:43.630737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:38:43.640978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:43.641509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:43.642367 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:43.642887 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:43.661940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Getting quotas for project 89e53e09771a4a478b48fa6e6f571d81. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:38:43.665829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Getting quotas for user 90c3a2e7255c4a909fc7e09730344930 and project 89e53e09771a4a478b48fa6e6f571d81. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:38:43.677647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:38:43.680070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:38:43.729516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e7e2e0bd-7eb7-4d74-b917-4d5f3fe99b21 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.681453 Jul 28 03:38:43.730653 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 92/210] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:38:43 2021] POST /compute/v2.1/servers => generated 383 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:38:43.741439 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d4ba4ff0-10b5-476c-a93e-9f5cb7e3e08e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:43.742051 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d4ba4ff0-10b5-476c-a93e-9f5cb7e3e08e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:43.796855 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d4ba4ff0-10b5-476c-a93e-9f5cb7e3e08e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:43.803971 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d4ba4ff0-10b5-476c-a93e-9f5cb7e3e08e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1220 microversion: 2.1 time: 0.066469 Jul 28 03:38:43.805700 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 119/211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:43 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1220 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:43.877178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-368832944", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a08c665d-fc97-4225-bb45-ecd81a76a165"}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:43.950297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] validate_networks() for [('a08c665d-fc97-4225-bb45-ecd81a76a165', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:38:44.031169 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7f55eccc-49ec-47c7-9f57-823dbd4b3ddb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:44.032274 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-7f55eccc-49ec-47c7-9f57-823dbd4b3ddb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:44.045488 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f55eccc-49ec-47c7-9f57-823dbd4b3ddb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:44.045958 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f55eccc-49ec-47c7-9f57-823dbd4b3ddb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:44.046928 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f55eccc-49ec-47c7-9f57-823dbd4b3ddb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:44.047632 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f55eccc-49ec-47c7-9f57-823dbd4b3ddb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:44.208992 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-7f55eccc-49ec-47c7-9f57-823dbd4b3ddb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 29269 microversion: 2.1 time: 0.181265 Jul 28 03:38:44.209644 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 120/212] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:44 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 29269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:44.221431 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e4c34399-b547-41d7-b392-a84f47635004 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:44.223213 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e4c34399-b547-41d7-b392-a84f47635004 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:44.230301 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e4c34399-b547-41d7-b392-a84f47635004 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:44.231082 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e4c34399-b547-41d7-b392-a84f47635004 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:44.232205 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e4c34399-b547-41d7-b392-a84f47635004 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:44.232864 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e4c34399-b547-41d7-b392-a84f47635004 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:44.348837 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e4c34399-b547-41d7-b392-a84f47635004 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 29631 microversion: 2.20 time: 0.137740 Jul 28 03:38:44.353620 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 121/213] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:44 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 29631 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:44.362318 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ab2c86ee-36ab-4195-8bbb-b5196eb825eb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:44.363796 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ab2c86ee-36ab-4195-8bbb-b5196eb825eb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:44.381792 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ab2c86ee-36ab-4195-8bbb-b5196eb825eb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:44.384804 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ab2c86ee-36ab-4195-8bbb-b5196eb825eb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:44.386967 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ab2c86ee-36ab-4195-8bbb-b5196eb825eb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:44.388269 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ab2c86ee-36ab-4195-8bbb-b5196eb825eb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:44.510897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:38:44.511589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:38:44.512485 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:38:44.512863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:38:44.513291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:38:44.526692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:44.531040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:44.537724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:44.538387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:44.568935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Getting quotas for project 89e53e09771a4a478b48fa6e6f571d81. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:38:44.574139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Getting quotas for user 90c3a2e7255c4a909fc7e09730344930 and project 89e53e09771a4a478b48fa6e6f571d81. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:38:44.594918 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:38:44.597618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:38:44.613510 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ab2c86ee-36ab-4195-8bbb-b5196eb825eb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:44.626573 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ab2c86ee-36ab-4195-8bbb-b5196eb825eb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1317 microversion: 2.1 time: 0.270053 Jul 28 03:38:44.628943 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 122/214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:44 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:44.665097 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cb5a7d48-a43d-4d4c-894e-2bff7861180b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.790580 Jul 28 03:38:44.667261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 93/215] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:38:43 2021] POST /compute/v2.1/servers => generated 383 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:38:44.676067 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d750a238-8141-460a-8285-c687eae293fe tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:44.676771 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d750a238-8141-460a-8285-c687eae293fe tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:44.764305 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d750a238-8141-460a-8285-c687eae293fe tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:44.774082 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d750a238-8141-460a-8285-c687eae293fe tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1221 microversion: 2.1 time: 0.101649 Jul 28 03:38:44.775223 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 123/216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:44 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:45.222876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-92a07d81-9828-41f5-9fda-88b6fa2e3ae0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:45.224569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-92a07d81-9828-41f5-9fda-88b6fa2e3ae0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:45.235962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92a07d81-9828-41f5-9fda-88b6fa2e3ae0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:45.236809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92a07d81-9828-41f5-9fda-88b6fa2e3ae0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:45.238479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92a07d81-9828-41f5-9fda-88b6fa2e3ae0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:45.240832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92a07d81-9828-41f5-9fda-88b6fa2e3ae0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:45.362673 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-6682ff58-5223-4481-baf6-9b06048c239e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:45.363661 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-6682ff58-5223-4481-baf6-9b06048c239e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:45.374023 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6682ff58-5223-4481-baf6-9b06048c239e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:45.376378 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6682ff58-5223-4481-baf6-9b06048c239e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:45.377300 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6682ff58-5223-4481-baf6-9b06048c239e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:45.377802 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6682ff58-5223-4481-baf6-9b06048c239e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:45.504069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-92a07d81-9828-41f5-9fda-88b6fa2e3ae0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 31146 microversion: 2.1 time: 0.285591 Jul 28 03:38:45.506589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 94/217] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:45 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 31146 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:38:45.574291 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-6682ff58-5223-4481-baf6-9b06048c239e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 32202 microversion: 2.20 time: 0.216506 Jul 28 03:38:45.577566 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 124/218] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:45 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 32202 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:45.662745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-215ea349-dcdf-4633-887d-3181976649e5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:45.663242 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-cb5c4252-008b-4063-9c78-8fa2bd4884a0 req-c1ece255-e9da-40a7-863f-e127743667bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4063b183-9e13-41da-9c3d-66ad0e28d877", "name": "network-vif-plugged", "status": "completed", "tag": "89207e90-606c-4b3a-ac81-aead843125ef"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:45.664221 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-215ea349-dcdf-4633-887d-3181976649e5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:45.664472 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:45.664472 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:38:45.672863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-215ea349-dcdf-4633-887d-3181976649e5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:45.673402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-215ea349-dcdf-4633-887d-3181976649e5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:45.674258 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-215ea349-dcdf-4633-887d-3181976649e5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:45.675434 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-215ea349-dcdf-4633-887d-3181976649e5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:45.677623 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-cb5c4252-008b-4063-9c78-8fa2bd4884a0 req-c1ece255-e9da-40a7-863f-e127743667bf service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:45.678070 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-cb5c4252-008b-4063-9c78-8fa2bd4884a0 req-c1ece255-e9da-40a7-863f-e127743667bf service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:45.723024 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-cb5c4252-008b-4063-9c78-8fa2bd4884a0 req-c1ece255-e9da-40a7-863f-e127743667bf service nova] Creating event network-vif-plugged:89207e90-606c-4b3a-ac81-aead843125ef for instance 4063b183-9e13-41da-9c3d-66ad0e28d877 on hv-cinder-73306 Jul 28 03:38:45.740488 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-cb5c4252-008b-4063-9c78-8fa2bd4884a0 req-c1ece255-e9da-40a7-863f-e127743667bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086824 Jul 28 03:38:45.741377 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 125/219] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:38:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:45.792371 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a2cf7690-91a5-4006-b31e-1191b9d1dac7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:45.793265 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a2cf7690-91a5-4006-b31e-1191b9d1dac7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:45.804758 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a2cf7690-91a5-4006-b31e-1191b9d1dac7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:45.805434 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a2cf7690-91a5-4006-b31e-1191b9d1dac7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:45.809957 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a2cf7690-91a5-4006-b31e-1191b9d1dac7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:45.810693 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a2cf7690-91a5-4006-b31e-1191b9d1dac7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:45.969120 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a2cf7690-91a5-4006-b31e-1191b9d1dac7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:45.989923 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a2cf7690-91a5-4006-b31e-1191b9d1dac7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1273 microversion: 2.1 time: 0.201491 Jul 28 03:38:45.993912 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 126/220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:45 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:46.188675 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-215ea349-dcdf-4633-887d-3181976649e5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:46.196653 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-215ea349-dcdf-4633-887d-3181976649e5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1317 microversion: 2.1 time: 0.550966 Jul 28 03:38:46.197227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 95/221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:45 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:46.515981 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c9aacd61-ca11-4735-a2db-be3cb0f693d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:46.516902 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c9aacd61-ca11-4735-a2db-be3cb0f693d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:46.523576 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9aacd61-ca11-4735-a2db-be3cb0f693d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:46.524273 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9aacd61-ca11-4735-a2db-be3cb0f693d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:46.525144 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9aacd61-ca11-4735-a2db-be3cb0f693d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:46.526301 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9aacd61-ca11-4735-a2db-be3cb0f693d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:46.589220 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dcbd7ae5-ef73-4b0a-8c6c-769e3b7636b6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:46.590359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dcbd7ae5-ef73-4b0a-8c6c-769e3b7636b6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:46.607101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcbd7ae5-ef73-4b0a-8c6c-769e3b7636b6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:46.607547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcbd7ae5-ef73-4b0a-8c6c-769e3b7636b6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:46.608378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcbd7ae5-ef73-4b0a-8c6c-769e3b7636b6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:46.608812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcbd7ae5-ef73-4b0a-8c6c-769e3b7636b6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:46.734843 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c9aacd61-ca11-4735-a2db-be3cb0f693d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 32252 microversion: 2.1 time: 0.222115 Jul 28 03:38:46.736426 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 127/222] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:46 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 32252 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:46.843429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dcbd7ae5-ef73-4b0a-8c6c-769e3b7636b6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 32928 microversion: 2.20 time: 0.258663 Jul 28 03:38:46.844909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 96/223] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:46 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 32928 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:47.008276 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-01767066-9878-431b-8ec3-9a455ddedd02 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:47.009216 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-01767066-9878-431b-8ec3-9a455ddedd02 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:47.037051 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-01767066-9878-431b-8ec3-9a455ddedd02 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:47.037698 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-01767066-9878-431b-8ec3-9a455ddedd02 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:47.040564 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-01767066-9878-431b-8ec3-9a455ddedd02 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:47.041779 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-01767066-9878-431b-8ec3-9a455ddedd02 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:47.155125 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-01767066-9878-431b-8ec3-9a455ddedd02 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:47.178804 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-01767066-9878-431b-8ec3-9a455ddedd02 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1279 microversion: 2.1 time: 0.173632 Jul 28 03:38:47.190777 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 128/224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:47 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:47.217070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-13a824b6-b128-49ca-a40e-64435f0f1570 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:47.218095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-13a824b6-b128-49ca-a40e-64435f0f1570 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:47.226637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-13a824b6-b128-49ca-a40e-64435f0f1570 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:47.227430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-13a824b6-b128-49ca-a40e-64435f0f1570 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:47.228353 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-13a824b6-b128-49ca-a40e-64435f0f1570 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:47.229454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-13a824b6-b128-49ca-a40e-64435f0f1570 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:47.432483 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-3c542366-4c49-41ef-9527-d804468d5cfd req-f66f4502-d336-4434-8e19-cb7d06fcc2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9eae018-81cf-4d77-8ac7-562c54a93e53", "tag": "1a641e29-3c70-42ab-97b9-e16e6ab74607"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:47.441302 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:47.441302 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:38:47.453220 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-3c542366-4c49-41ef-9527-d804468d5cfd req-f66f4502-d336-4434-8e19-cb7d06fcc2f9 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:47.453985 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-3c542366-4c49-41ef-9527-d804468d5cfd req-f66f4502-d336-4434-8e19-cb7d06fcc2f9 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:47.469250 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-3c542366-4c49-41ef-9527-d804468d5cfd req-f66f4502-d336-4434-8e19-cb7d06fcc2f9 service nova] Creating event network-changed:1a641e29-3c70-42ab-97b9-e16e6ab74607 for instance a9eae018-81cf-4d77-8ac7-562c54a93e53 on hv-cinder-73306 Jul 28 03:38:47.484246 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-3c542366-4c49-41ef-9527-d804468d5cfd req-f66f4502-d336-4434-8e19-cb7d06fcc2f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055496 Jul 28 03:38:47.485925 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 129/225] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:38:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:38:47.543466 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-13a824b6-b128-49ca-a40e-64435f0f1570 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:47.551225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-13a824b6-b128-49ca-a40e-64435f0f1570 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1317 microversion: 2.1 time: 0.341488 Jul 28 03:38:47.554232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 97/226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:47 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:47.749568 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-df7fd3c5-3456-411d-a9c6-2a03874038ec tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:47.750629 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-df7fd3c5-3456-411d-a9c6-2a03874038ec tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:47.766207 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-df7fd3c5-3456-411d-a9c6-2a03874038ec tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:47.766665 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-df7fd3c5-3456-411d-a9c6-2a03874038ec tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:47.767473 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-df7fd3c5-3456-411d-a9c6-2a03874038ec tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:47.767998 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-df7fd3c5-3456-411d-a9c6-2a03874038ec tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:47.856576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9010b385-e1b5-42c7-8772-20ba4cbe7df4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:47.857499 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9010b385-e1b5-42c7-8772-20ba4cbe7df4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:47.869256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9010b385-e1b5-42c7-8772-20ba4cbe7df4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:47.870138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9010b385-e1b5-42c7-8772-20ba4cbe7df4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:47.871694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9010b385-e1b5-42c7-8772-20ba4cbe7df4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:47.873595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9010b385-e1b5-42c7-8772-20ba4cbe7df4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:47.937750 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-df7fd3c5-3456-411d-a9c6-2a03874038ec tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 32675 microversion: 2.1 time: 0.193915 Jul 28 03:38:47.943224 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 130/227] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:47 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 32675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:48.045294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9010b385-e1b5-42c7-8772-20ba4cbe7df4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 33313 microversion: 2.20 time: 0.193307 Jul 28 03:38:48.045948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 98/228] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:47 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 33313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:48.196722 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-4faf78ac-442d-4b5a-a67f-2437f9ffa30c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:48.198098 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-4faf78ac-442d-4b5a-a67f-2437f9ffa30c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:48.216594 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4faf78ac-442d-4b5a-a67f-2437f9ffa30c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:48.217694 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4faf78ac-442d-4b5a-a67f-2437f9ffa30c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:48.218757 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4faf78ac-442d-4b5a-a67f-2437f9ffa30c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:48.220516 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4faf78ac-442d-4b5a-a67f-2437f9ffa30c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:48.562360 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-4faf78ac-442d-4b5a-a67f-2437f9ffa30c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:48.572391 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-aaf82fa9-ad7f-489a-87a4-c8fa5ad0ce99 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:48.573625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-aaf82fa9-ad7f-489a-87a4-c8fa5ad0ce99 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:48.574472 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-4faf78ac-442d-4b5a-a67f-2437f9ffa30c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1321 microversion: 2.1 time: 0.381753 Jul 28 03:38:48.583834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aaf82fa9-ad7f-489a-87a4-c8fa5ad0ce99 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:48.583834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aaf82fa9-ad7f-489a-87a4-c8fa5ad0ce99 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:48.583834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aaf82fa9-ad7f-489a-87a4-c8fa5ad0ce99 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:48.583834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aaf82fa9-ad7f-489a-87a4-c8fa5ad0ce99 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:48.584516 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 131/229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:48 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:48.902388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-aaf82fa9-ad7f-489a-87a4-c8fa5ad0ce99 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:48.913170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-aaf82fa9-ad7f-489a-87a4-c8fa5ad0ce99 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1507 microversion: 2.1 time: 0.347860 Jul 28 03:38:48.919941 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 99/230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:48 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:48.950892 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2aaa5e02-c7ef-4f2c-97bf-fb6b452cf516 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:48.951853 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2aaa5e02-c7ef-4f2c-97bf-fb6b452cf516 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:48.961132 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2aaa5e02-c7ef-4f2c-97bf-fb6b452cf516 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:48.961852 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2aaa5e02-c7ef-4f2c-97bf-fb6b452cf516 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:48.964621 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2aaa5e02-c7ef-4f2c-97bf-fb6b452cf516 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:48.965707 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2aaa5e02-c7ef-4f2c-97bf-fb6b452cf516 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:49.033866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-0ca220e3-53d3-441e-be81-71790d8bda8d req-d3b1dc8c-ac45-41bb-8903-17964f8f7a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ff2a400-ddb8-40da-9f6e-09ebc33da17c", "tag": "29cc949d-5a73-4ff7-a43e-00ddd4fbc84b"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:49.035731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:49.035731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:38:49.043784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-0ca220e3-53d3-441e-be81-71790d8bda8d req-d3b1dc8c-ac45-41bb-8903-17964f8f7a28 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:49.044739 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-0ca220e3-53d3-441e-be81-71790d8bda8d req-d3b1dc8c-ac45-41bb-8903-17964f8f7a28 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:49.056893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-0ca220e3-53d3-441e-be81-71790d8bda8d req-d3b1dc8c-ac45-41bb-8903-17964f8f7a28 service nova] Creating event network-changed:29cc949d-5a73-4ff7-a43e-00ddd4fbc84b for instance 3ff2a400-ddb8-40da-9f6e-09ebc33da17c on hv-cinder-73306 Jul 28 03:38:49.061978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-0ca220e3-53d3-441e-be81-71790d8bda8d req-d3b1dc8c-ac45-41bb-8903-17964f8f7a28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031515 Jul 28 03:38:49.062952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 100/231] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:38:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:38:49.068707 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-49a2b82e-6010-45e3-bccf-fb50db3cfedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:49.069697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-49a2b82e-6010-45e3-bccf-fb50db3cfedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:49.076549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49a2b82e-6010-45e3-bccf-fb50db3cfedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:49.076999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49a2b82e-6010-45e3-bccf-fb50db3cfedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:49.077783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49a2b82e-6010-45e3-bccf-fb50db3cfedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:49.078241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49a2b82e-6010-45e3-bccf-fb50db3cfedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:51.696927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-49a2b82e-6010-45e3-bccf-fb50db3cfedd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 36542 microversion: 2.20 time: 2.632315 Jul 28 03:38:51.698303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 101/232] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:49 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 36542 bytes in 2634 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:51.702937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2f485461-45a2-47a2-86e9-49575c657737 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:51.703701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2f485461-45a2-47a2-86e9-49575c657737 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:51.710154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f485461-45a2-47a2-86e9-49575c657737 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:51.710602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f485461-45a2-47a2-86e9-49575c657737 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:51.711355 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f485461-45a2-47a2-86e9-49575c657737 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:51.711811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f485461-45a2-47a2-86e9-49575c657737 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:51.723489 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2aaa5e02-c7ef-4f2c-97bf-fb6b452cf516 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 35226 microversion: 2.1 time: 2.776767 Jul 28 03:38:51.724365 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 132/233] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:48 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 35226 bytes in 2778 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:51.834624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2f485461-45a2-47a2-86e9-49575c657737 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:51.842439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2f485461-45a2-47a2-86e9-49575c657737 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1321 microversion: 2.1 time: 0.143193 Jul 28 03:38:51.843002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 102/234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:51 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1321 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:52.399279 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-46c89c90-37c7-4e0c-926b-88dd32d9020b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e03c0cc-9340-4e2f-8cbf-b4348eaeea85"}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:52.400414 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-46c89c90-37c7-4e0c-926b-88dd32d9020b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:52.407486 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-46c89c90-37c7-4e0c-926b-88dd32d9020b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:52.407970 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-46c89c90-37c7-4e0c-926b-88dd32d9020b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:52.408742 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-46c89c90-37c7-4e0c-926b-88dd32d9020b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:52.409176 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-46c89c90-37c7-4e0c-926b-88dd32d9020b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:52.688912 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-46c89c90-37c7-4e0c-926b-88dd32d9020b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "POST /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293606 Jul 28 03:38:52.689511 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 133/235] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 03:38:52 2021] POST /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:52.709024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-79c277c5-8287-4415-929e-68246eaac6db tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:52.710525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-79c277c5-8287-4415-929e-68246eaac6db tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:52.718829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79c277c5-8287-4415-929e-68246eaac6db tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:52.719958 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79c277c5-8287-4415-929e-68246eaac6db tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:52.721102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79c277c5-8287-4415-929e-68246eaac6db tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:52.721819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79c277c5-8287-4415-929e-68246eaac6db tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:52.736280 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-51c80973-b5f9-45cd-adec-56de660fb680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:52.737846 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-51c80973-b5f9-45cd-adec-56de660fb680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:52.746163 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-51c80973-b5f9-45cd-adec-56de660fb680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:52.746719 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-51c80973-b5f9-45cd-adec-56de660fb680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:52.756373 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-51c80973-b5f9-45cd-adec-56de660fb680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:52.756373 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-51c80973-b5f9-45cd-adec-56de660fb680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:52.903051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-79c277c5-8287-4415-929e-68246eaac6db tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 37225 microversion: 2.20 time: 0.196903 Jul 28 03:38:52.903741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 103/236] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:52 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 37225 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:52.908535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-611c971b-c328-46ea-ab50-baf10b10dc58 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:52.909234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-611c971b-c328-46ea-ab50-baf10b10dc58 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:52.916410 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-611c971b-c328-46ea-ab50-baf10b10dc58 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:52.916872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-611c971b-c328-46ea-ab50-baf10b10dc58 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:52.917671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-611c971b-c328-46ea-ab50-baf10b10dc58 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:52.918127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-611c971b-c328-46ea-ab50-baf10b10dc58 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:52.933573 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-51c80973-b5f9-45cd-adec-56de660fb680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 35797 microversion: 2.1 time: 0.201446 Jul 28 03:38:52.938078 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 134/237] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:52 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 35797 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:38:53.043775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-611c971b-c328-46ea-ab50-baf10b10dc58 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:53.058806 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-611c971b-c328-46ea-ab50-baf10b10dc58 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1321 microversion: 2.1 time: 0.153540 Jul 28 03:38:53.059598 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 104/238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:52 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:53.914982 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-72dc81f9-72c6-420d-87c7-4f755630a245 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:53.916086 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-72dc81f9-72c6-420d-87c7-4f755630a245 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:53.923065 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-72dc81f9-72c6-420d-87c7-4f755630a245 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:53.923513 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-72dc81f9-72c6-420d-87c7-4f755630a245 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:53.924317 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-72dc81f9-72c6-420d-87c7-4f755630a245 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:53.924741 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-72dc81f9-72c6-420d-87c7-4f755630a245 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:53.945389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8404de27-27aa-4f2d-942a-f580282dcc59 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:53.946808 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8404de27-27aa-4f2d-942a-f580282dcc59 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:53.953842 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8404de27-27aa-4f2d-942a-f580282dcc59 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:53.954471 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8404de27-27aa-4f2d-942a-f580282dcc59 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:53.955399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8404de27-27aa-4f2d-942a-f580282dcc59 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:53.956020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8404de27-27aa-4f2d-942a-f580282dcc59 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:54.063757 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-72dc81f9-72c6-420d-87c7-4f755630a245 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 37962 microversion: 2.20 time: 0.152465 Jul 28 03:38:54.070174 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 135/239] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:53 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 37962 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:54.077896 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b77756c1-02b3-4f82-8869-7a8bd20dde5b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:54.078851 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b77756c1-02b3-4f82-8869-7a8bd20dde5b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:54.087177 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b77756c1-02b3-4f82-8869-7a8bd20dde5b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:54.088156 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b77756c1-02b3-4f82-8869-7a8bd20dde5b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:54.089946 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b77756c1-02b3-4f82-8869-7a8bd20dde5b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:54.090535 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b77756c1-02b3-4f82-8869-7a8bd20dde5b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:54.095561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8404de27-27aa-4f2d-942a-f580282dcc59 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 36645 microversion: 2.1 time: 0.151989 Jul 28 03:38:54.096415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 105/240] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:53 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 36645 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:38:54.235044 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b77756c1-02b3-4f82-8869-7a8bd20dde5b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:54.242367 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b77756c1-02b3-4f82-8869-7a8bd20dde5b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1321 microversion: 2.1 time: 0.169204 Jul 28 03:38:54.247751 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 136/241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:54 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:55.080990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ddc4485d-b686-480a-9d10-72b3055d75ff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:55.082263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ddc4485d-b686-480a-9d10-72b3055d75ff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:55.089078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ddc4485d-b686-480a-9d10-72b3055d75ff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:55.089705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ddc4485d-b686-480a-9d10-72b3055d75ff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:55.090679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ddc4485d-b686-480a-9d10-72b3055d75ff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:55.091324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ddc4485d-b686-480a-9d10-72b3055d75ff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:55.108004 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-32ccc09c-f7da-4b77-9f34-81d6fad88660 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:55.109128 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-32ccc09c-f7da-4b77-9f34-81d6fad88660 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:55.116179 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-32ccc09c-f7da-4b77-9f34-81d6fad88660 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:55.116889 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-32ccc09c-f7da-4b77-9f34-81d6fad88660 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:55.117963 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-32ccc09c-f7da-4b77-9f34-81d6fad88660 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:55.118502 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-32ccc09c-f7da-4b77-9f34-81d6fad88660 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:56.967177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ddc4485d-b686-480a-9d10-72b3055d75ff tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 38159 microversion: 2.20 time: 1.888110 Jul 28 03:38:56.967177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 106/242] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:55 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 38159 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:38:56.976202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e61b0c5f-2719-43ca-9b22-37f3cf170475 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:56.976897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e61b0c5f-2719-43ca-9b22-37f3cf170475 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:56.983225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e61b0c5f-2719-43ca-9b22-37f3cf170475 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:56.983688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e61b0c5f-2719-43ca-9b22-37f3cf170475 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:56.984489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e61b0c5f-2719-43ca-9b22-37f3cf170475 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:56.984921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e61b0c5f-2719-43ca-9b22-37f3cf170475 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:56.995392 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-32ccc09c-f7da-4b77-9f34-81d6fad88660 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 38191 microversion: 2.1 time: 1.891652 Jul 28 03:38:56.996923 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 137/243] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:55 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 38191 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:38:57.108425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e61b0c5f-2719-43ca-9b22-37f3cf170475 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:57.115733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e61b0c5f-2719-43ca-9b22-37f3cf170475 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1321 microversion: 2.1 time: 0.144468 Jul 28 03:38:57.116286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 107/244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:56 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:57.977833 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a3c604f0-a7ba-422a-9822-d097ec1c77d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:57.978819 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a3c604f0-a7ba-422a-9822-d097ec1c77d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:57.985687 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a3c604f0-a7ba-422a-9822-d097ec1c77d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:57.986135 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a3c604f0-a7ba-422a-9822-d097ec1c77d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:57.986896 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a3c604f0-a7ba-422a-9822-d097ec1c77d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:57.987326 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a3c604f0-a7ba-422a-9822-d097ec1c77d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:58.010059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-39cec24a-894d-453b-a370-af03783c3c7a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:58.012481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-39cec24a-894d-453b-a370-af03783c3c7a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:58.021106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-39cec24a-894d-453b-a370-af03783c3c7a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:58.021749 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-39cec24a-894d-453b-a370-af03783c3c7a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:58.023008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-39cec24a-894d-453b-a370-af03783c3c7a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:58.023783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-39cec24a-894d-453b-a370-af03783c3c7a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:58.094252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a3c604f0-a7ba-422a-9822-d097ec1c77d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 38166 microversion: 2.20 time: 0.120145 Jul 28 03:38:58.095905 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 138/245] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:57 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 38166 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:58.101807 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-908889866", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "networks": [{"uuid": "70ad9fef-d2a8-4a68-a9fa-5f970fad1121"}]}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:58.158065 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.network.neutron [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] validate_networks() for [('70ad9fef-d2a8-4a68-a9fa-5f970fad1121', None, None, None)] {{(pid=119155) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:38:58.182129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-39cec24a-894d-453b-a370-af03783c3c7a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 38203 microversion: 2.1 time: 0.177238 Jul 28 03:38:58.186950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 108/246] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:58 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 38203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:38:58.188543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-83631963-65d7-47a5-ae17-9f4c64447bf7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:58.189244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-83631963-65d7-47a5-ae17-9f4c64447bf7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:58.195583 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83631963-65d7-47a5-ae17-9f4c64447bf7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:58.196070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83631963-65d7-47a5-ae17-9f4c64447bf7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:58.196899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83631963-65d7-47a5-ae17-9f4c64447bf7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:58.197288 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83631963-65d7-47a5-ae17-9f4c64447bf7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:58.321977 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-83631963-65d7-47a5-ae17-9f4c64447bf7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:58.330251 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-83631963-65d7-47a5-ae17-9f4c64447bf7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1321 microversion: 2.1 time: 0.145394 Jul 28 03:38:58.331629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 109/247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:58 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:58.514029 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Flavor limits 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:38:58.514483 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Image limits 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:38:58.514995 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Flavor pref 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:38:58.515409 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Image pref 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:38:58.515865 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:38:58.525491 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:58.525959 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:58.527248 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:58.528252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:58.544977 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.quota [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Getting quotas for project 390a8b33f669478db43fb9ad4259eccb. Resources: {'ram', 'cores', 'instances'} {{(pid=119155) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:38:58.548863 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.quota [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Getting quotas for user 0db58e38f88a4965a94d51882db44960 and project 390a8b33f669478db43fb9ad4259eccb. Resources: {'ram', 'cores', 'instances'} {{(pid=119155) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:38:58.559456 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Going to run 1 instances... {{(pid=119155) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:38:58.561834 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119155) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:38:58.606825 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-313428f4-af17-453e-9a0d-d803959726d2 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509878 Jul 28 03:38:58.607495 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 139/248] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:38:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:38:58.617320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dcf3c604-799a-410e-b4bc-7485eb8a7964 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:58.617933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dcf3c604-799a-410e-b4bc-7485eb8a7964 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:58.668382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dcf3c604-799a-410e-b4bc-7485eb8a7964 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:58.674720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dcf3c604-799a-410e-b4bc-7485eb8a7964 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1213 microversion: 2.1 time: 0.061273 Jul 28 03:38:58.675276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 110/249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:58 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1213 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:59.107890 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5f2922f6-5cc5-4f3f-9d08-a421805efd98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:59.109941 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5f2922f6-5cc5-4f3f-9d08-a421805efd98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:59.129508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-92549ea4-d28d-450a-8650-64fa5d4a3f2b req-d943367b-9bda-45ee-9b11-97174ff83cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff2a400-ddb8-40da-9f6e-09ebc33da17c", "name": "network-vif-plugged", "status": "completed", "tag": "29cc949d-5a73-4ff7-a43e-00ddd4fbc84b"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:59.131183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:59.131183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:38:59.134203 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f2922f6-5cc5-4f3f-9d08-a421805efd98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.134662 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f2922f6-5cc5-4f3f-9d08-a421805efd98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.135451 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f2922f6-5cc5-4f3f-9d08-a421805efd98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.140151 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f2922f6-5cc5-4f3f-9d08-a421805efd98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.146664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-92549ea4-d28d-450a-8650-64fa5d4a3f2b req-d943367b-9bda-45ee-9b11-97174ff83cd5 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.147115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-92549ea4-d28d-450a-8650-64fa5d4a3f2b req-d943367b-9bda-45ee-9b11-97174ff83cd5 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.171320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-92549ea4-d28d-450a-8650-64fa5d4a3f2b req-d943367b-9bda-45ee-9b11-97174ff83cd5 service nova] Creating event network-vif-plugged:29cc949d-5a73-4ff7-a43e-00ddd4fbc84b for instance 3ff2a400-ddb8-40da-9f6e-09ebc33da17c on hv-cinder-73306 Jul 28 03:38:59.177002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-92549ea4-d28d-450a-8650-64fa5d4a3f2b req-d943367b-9bda-45ee-9b11-97174ff83cd5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052088 Jul 28 03:38:59.178773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 111/250] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:38:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:38:59.205301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-27155f43-6a1f-4d21-9f67-8764ca2b04c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:59.206343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-27155f43-6a1f-4d21-9f67-8764ca2b04c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:59.216857 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-27155f43-6a1f-4d21-9f67-8764ca2b04c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.217602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-27155f43-6a1f-4d21-9f67-8764ca2b04c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.218399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-27155f43-6a1f-4d21-9f67-8764ca2b04c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.218992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-27155f43-6a1f-4d21-9f67-8764ca2b04c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.287365 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5f2922f6-5cc5-4f3f-9d08-a421805efd98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 200 len: 38302 microversion: 2.20 time: 0.184393 Jul 28 03:38:59.296168 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 140/251] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:38:59 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 38302 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:59.312201 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-18a3b869-5f1e-41c8-9ebf-2f60bb210499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:59.313043 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-18a3b869-5f1e-41c8-9ebf-2f60bb210499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:59.333535 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-18a3b869-5f1e-41c8-9ebf-2f60bb210499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.334321 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-18a3b869-5f1e-41c8-9ebf-2f60bb210499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.334908 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-18a3b869-5f1e-41c8-9ebf-2f60bb210499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.335403 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-18a3b869-5f1e-41c8-9ebf-2f60bb210499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.369897 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-18a3b869-5f1e-41c8-9ebf-2f60bb210499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/ips" status: 200 len: 150 microversion: 2.20 time: 0.071939 Jul 28 03:38:59.371336 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 141/252] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Jul 28 03:38:59 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/ips => generated 150 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:59.381842 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fd80b993-0d65-4372-92b1-27883a31231b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:59.382904 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-fd80b993-0d65-4372-92b1-27883a31231b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:59.392367 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fd80b993-0d65-4372-92b1-27883a31231b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.393233 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fd80b993-0d65-4372-92b1-27883a31231b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.394356 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fd80b993-0d65-4372-92b1-27883a31231b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.396517 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fd80b993-0d65-4372-92b1-27883a31231b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.397111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-27155f43-6a1f-4d21-9f67-8764ca2b04c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 200 len: 38321 microversion: 2.1 time: 0.205814 Jul 28 03:38:59.398160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 112/253] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:38:59 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 38321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:38:59.410052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-45b4a418-7031-4d27-824a-013b3675e10e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:59.410802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-45b4a418-7031-4d27-824a-013b3675e10e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:59.419043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45b4a418-7031-4d27-824a-013b3675e10e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.419797 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45b4a418-7031-4d27-824a-013b3675e10e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.421046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45b4a418-7031-4d27-824a-013b3675e10e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.421676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45b4a418-7031-4d27-824a-013b3675e10e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.471939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-45b4a418-7031-4d27-824a-013b3675e10e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/ips" status: 200 len: 145 microversion: 2.1 time: 0.066906 Jul 28 03:38:59.481509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 113/254] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Jul 28 03:38:59 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/ips => generated 145 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:59.645671 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-fd80b993-0d65-4372-92b1-27883a31231b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:59.656357 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-fd80b993-0d65-4372-92b1-27883a31231b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1321 microversion: 2.1 time: 0.283562 Jul 28 03:38:59.657194 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 142/255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:59 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:59.693904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-14556c1f-e2cb-4e17-b506-1dcf1ee5c0fa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:59.694945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-14556c1f-e2cb-4e17-b506-1dcf1ee5c0fa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:38:59.702120 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14556c1f-e2cb-4e17-b506-1dcf1ee5c0fa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.702655 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14556c1f-e2cb-4e17-b506-1dcf1ee5c0fa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.704467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14556c1f-e2cb-4e17-b506-1dcf1ee5c0fa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:38:59.704467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14556c1f-e2cb-4e17-b506-1dcf1ee5c0fa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:38:59.777879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-14556c1f-e2cb-4e17-b506-1dcf1ee5c0fa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:59.787328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-14556c1f-e2cb-4e17-b506-1dcf1ee5c0fa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1265 microversion: 2.1 time: 0.097777 Jul 28 03:38:59.788088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 114/256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:38:59 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:00.677695 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-3b64792e-1556-44f0-b0c2-e72d391df699 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:00.678651 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-3b64792e-1556-44f0-b0c2-e72d391df699 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:00.686784 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3b64792e-1556-44f0-b0c2-e72d391df699 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:00.687584 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3b64792e-1556-44f0-b0c2-e72d391df699 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:00.688474 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3b64792e-1556-44f0-b0c2-e72d391df699 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:00.689003 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3b64792e-1556-44f0-b0c2-e72d391df699 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:00.806713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b0ca6fac-3675-4d04-bd3d-0f5f4abfcecb tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:00.809011 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b0ca6fac-3675-4d04-bd3d-0f5f4abfcecb tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:00.817265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0ca6fac-3675-4d04-bd3d-0f5f4abfcecb tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:00.817871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0ca6fac-3675-4d04-bd3d-0f5f4abfcecb tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:00.819080 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0ca6fac-3675-4d04-bd3d-0f5f4abfcecb tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:00.819670 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0ca6fac-3675-4d04-bd3d-0f5f4abfcecb tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:00.898153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b0ca6fac-3675-4d04-bd3d-0f5f4abfcecb tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:00.906122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b0ca6fac-3675-4d04-bd3d-0f5f4abfcecb tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1271 microversion: 2.1 time: 0.103671 Jul 28 03:39:00.907392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 115/257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:00 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:00.965026 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3b64792e-1556-44f0-b0c2-e72d391df699 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:00.973542 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-3b64792e-1556-44f0-b0c2-e72d391df699 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1321 microversion: 2.1 time: 0.300245 Jul 28 03:39:00.974281 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 143/258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:00 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:01.203533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-bf1b6db9-87fa-4e45-a459-892a0f122276 req-e78eb5fc-5878-45c1-8e6a-139c29cf4003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eae018-81cf-4d77-8ac7-562c54a93e53", "name": "network-vif-plugged", "status": "completed", "tag": "1a641e29-3c70-42ab-97b9-e16e6ab74607"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:01.205295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:01.205295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:39:01.238540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-bf1b6db9-87fa-4e45-a459-892a0f122276 req-e78eb5fc-5878-45c1-8e6a-139c29cf4003 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:01.239266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-bf1b6db9-87fa-4e45-a459-892a0f122276 req-e78eb5fc-5878-45c1-8e6a-139c29cf4003 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:01.266486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-bf1b6db9-87fa-4e45-a459-892a0f122276 req-e78eb5fc-5878-45c1-8e6a-139c29cf4003 service nova] Creating event network-vif-plugged:1a641e29-3c70-42ab-97b9-e16e6ab74607 for instance a9eae018-81cf-4d77-8ac7-562c54a93e53 on hv-cinder-73306 Jul 28 03:39:01.276177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-bf1b6db9-87fa-4e45-a459-892a0f122276 req-e78eb5fc-5878-45c1-8e6a-139c29cf4003 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077287 Jul 28 03:39:01.284188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 116/259] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:01.349016 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-dc65f1be-7d98-4060-87fc-b757561f3ed7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e03c0cc-9340-4e2f-8cbf-b4348eaeea85"}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:01.360198 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-dc65f1be-7d98-4060-87fc-b757561f3ed7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:01.387744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dc65f1be-7d98-4060-87fc-b757561f3ed7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:01.392078 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dc65f1be-7d98-4060-87fc-b757561f3ed7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:01.396254 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dc65f1be-7d98-4060-87fc-b757561f3ed7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:01.396702 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dc65f1be-7d98-4060-87fc-b757561f3ed7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:01.555886 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-dc65f1be-7d98-4060-87fc-b757561f3ed7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] HTTP exception thrown: Invalid volume: volume 4e03c0cc-9340-4e2f-8cbf-b4348eaeea85 is already attached to instances: 4063b183-9e13-41da-9c3d-66ad0e28d877 Jul 28 03:39:01.556672 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-dc65f1be-7d98-4060-87fc-b757561f3ed7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Returning 400 to user: Invalid volume: volume 4e03c0cc-9340-4e2f-8cbf-b4348eaeea85 is already attached to instances: 4063b183-9e13-41da-9c3d-66ad0e28d877 {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:39:01.557692 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-dc65f1be-7d98-4060-87fc-b757561f3ed7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "POST /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.212745 Jul 28 03:39:01.559254 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 144/260] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 03:39:01 2021] POST /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877/os-volume_attachments => generated 174 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:39:01.660517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f65a25d1-7fea-479f-85a6-da77ca403ac1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:01.661096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f65a25d1-7fea-479f-85a6-da77ca403ac1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:01.667952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f65a25d1-7fea-479f-85a6-da77ca403ac1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:01.668408 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f65a25d1-7fea-479f-85a6-da77ca403ac1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:01.669183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f65a25d1-7fea-479f-85a6-da77ca403ac1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:01.669781 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f65a25d1-7fea-479f-85a6-da77ca403ac1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:01.769522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-f65a25d1-7fea-479f-85a6-da77ca403ac1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lazy-loading 'services' on Instance uuid 4063b183-9e13-41da-9c3d-66ad0e28d877 {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:39:01.808852 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ce5f8dea-3847-4435-b2c3-f71e1627eeb6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:01.809424 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ce5f8dea-3847-4435-b2c3-f71e1627eeb6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:01.815151 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ce5f8dea-3847-4435-b2c3-f71e1627eeb6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:01.816176 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ce5f8dea-3847-4435-b2c3-f71e1627eeb6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:01.817162 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ce5f8dea-3847-4435-b2c3-f71e1627eeb6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:01.817916 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ce5f8dea-3847-4435-b2c3-f71e1627eeb6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:01.844892 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.objects.instance [None req-ce5f8dea-3847-4435-b2c3-f71e1627eeb6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lazy-loading 'flavor' on Instance uuid 622af242-a6fc-4f2d-9f03-61e88ee5e89f {{(pid=119155) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:39:01.846046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f65a25d1-7fea-479f-85a6-da77ca403ac1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877/os-volume_attachments/4e03c0cc-9340-4e2f-8cbf-b4348eaeea85" status: 202 len: 0 microversion: 2.1 time: 0.189387 Jul 28 03:39:01.850538 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 117/261] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Jul 28 03:39:01 2021] DELETE /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877/os-volume_attachments/4e03c0cc-9340-4e2f-8cbf-b4348eaeea85 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:39:01.923692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8d61510f-0199-46df-9f1b-7e743d7ebb3f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:01.924551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8d61510f-0199-46df-9f1b-7e743d7ebb3f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:01.931598 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d61510f-0199-46df-9f1b-7e743d7ebb3f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:01.932421 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d61510f-0199-46df-9f1b-7e743d7ebb3f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:01.934747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d61510f-0199-46df-9f1b-7e743d7ebb3f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:01.935383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d61510f-0199-46df-9f1b-7e743d7ebb3f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.142622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d61510f-0199-46df-9f1b-7e743d7ebb3f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:02.151436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8d61510f-0199-46df-9f1b-7e743d7ebb3f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1313 microversion: 2.1 time: 0.231956 Jul 28 03:39:02.152457 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 118/262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:01 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:02.160788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-26b153f2-484a-404e-9831-70e25849d65d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:02.161628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-26b153f2-484a-404e-9831-70e25849d65d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:02.175285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26b153f2-484a-404e-9831-70e25849d65d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.176303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26b153f2-484a-404e-9831-70e25849d65d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.177240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26b153f2-484a-404e-9831-70e25849d65d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.178500 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26b153f2-484a-404e-9831-70e25849d65d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.333923 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ce5f8dea-3847-4435-b2c3-f71e1627eeb6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 202 len: 0 microversion: 2.20 time: 0.529032 Jul 28 03:39:02.334915 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 145/263] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:39:01 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:39:02.345032 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b9b49855-27d6-4b66-9544-7f432f9ed5d6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:02.345873 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b9b49855-27d6-4b66-9544-7f432f9ed5d6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:02.355180 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b9b49855-27d6-4b66-9544-7f432f9ed5d6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.355781 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b9b49855-27d6-4b66-9544-7f432f9ed5d6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.357317 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b9b49855-27d6-4b66-9544-7f432f9ed5d6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.358418 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b9b49855-27d6-4b66-9544-7f432f9ed5d6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.376360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-26b153f2-484a-404e-9831-70e25849d65d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:02.387283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-26b153f2-484a-404e-9831-70e25849d65d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1515 microversion: 2.1 time: 0.233635 Jul 28 03:39:02.388840 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 119/264] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:02 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:02.404355 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6e18c522-489e-428d-a015-ccdeabd7a5cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:02.405525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6e18c522-489e-428d-a015-ccdeabd7a5cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:02.413855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e18c522-489e-428d-a015-ccdeabd7a5cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.414531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e18c522-489e-428d-a015-ccdeabd7a5cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.415619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e18c522-489e-428d-a015-ccdeabd7a5cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.416331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e18c522-489e-428d-a015-ccdeabd7a5cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.445708 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-6e18c522-489e-428d-a015-ccdeabd7a5cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lazy-loading 'flavor' on Instance uuid 3ff2a400-ddb8-40da-9f6e-09ebc33da17c {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:39:02.584622 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b9b49855-27d6-4b66-9544-7f432f9ed5d6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:02.593598 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b9b49855-27d6-4b66-9544-7f432f9ed5d6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:02.608391 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b9b49855-27d6-4b66-9544-7f432f9ed5d6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:02.611476 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b9b49855-27d6-4b66-9544-7f432f9ed5d6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.270726 Jul 28 03:39:02.613212 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 146/265] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:02 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:02.619250 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-c533020c-62e6-4812-b736-3b4a29bdd1ad req-77a6fedb-6497-4449-bf21-93a28a356771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5b4e64-7b52-4fdf-bc58-56fce40dfc51", "tag": "ccaf035b-9463-4fa8-9a86-6365b8e3f28e"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:02.622485 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:02.622485 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:39:02.632460 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-c533020c-62e6-4812-b736-3b4a29bdd1ad req-77a6fedb-6497-4449-bf21-93a28a356771 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.634347 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-c533020c-62e6-4812-b736-3b4a29bdd1ad req-77a6fedb-6497-4449-bf21-93a28a356771 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.648453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6e18c522-489e-428d-a015-ccdeabd7a5cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "POST /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c/action" status: 200 len: 32 microversion: 2.1 time: 0.247454 Jul 28 03:39:02.652953 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 120/266] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:39:02 2021] POST /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c/action => generated 32 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:39:02.657576 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-c533020c-62e6-4812-b736-3b4a29bdd1ad req-77a6fedb-6497-4449-bf21-93a28a356771 service nova] Creating event network-changed:ccaf035b-9463-4fa8-9a86-6365b8e3f28e for instance 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 on hv-cinder-73306 Jul 28 03:39:02.659693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7aac3fd2-5804-479f-bb00-c4a8b448a412 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5a68c7e-111a-41b9-adca-70cb7a1e37c1"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:02.661909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7aac3fd2-5804-479f-bb00-c4a8b448a412 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:02.662348 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-c533020c-62e6-4812-b736-3b4a29bdd1ad req-77a6fedb-6497-4449-bf21-93a28a356771 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047682 Jul 28 03:39:02.663591 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 147/267] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:02.670271 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f26ccaef-6b73-4c3a-89b1-08cd03ca1eb8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:02.671114 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f26ccaef-6b73-4c3a-89b1-08cd03ca1eb8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:02.674268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7aac3fd2-5804-479f-bb00-c4a8b448a412 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.674752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7aac3fd2-5804-479f-bb00-c4a8b448a412 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.675561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7aac3fd2-5804-479f-bb00-c4a8b448a412 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.676388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7aac3fd2-5804-479f-bb00-c4a8b448a412 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.677669 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f26ccaef-6b73-4c3a-89b1-08cd03ca1eb8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.678117 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f26ccaef-6b73-4c3a-89b1-08cd03ca1eb8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.678896 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f26ccaef-6b73-4c3a-89b1-08cd03ca1eb8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:02.679328 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f26ccaef-6b73-4c3a-89b1-08cd03ca1eb8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:02.921163 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f26ccaef-6b73-4c3a-89b1-08cd03ca1eb8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:02.936412 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f26ccaef-6b73-4c3a-89b1-08cd03ca1eb8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.271265 Jul 28 03:39:02.937514 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 148/268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:02 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:03.062441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7aac3fd2-5804-479f-bb00-c4a8b448a412 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.407051 Jul 28 03:39:03.063638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 121/269] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 03:39:02 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:03.182290 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-cab1dd42-d55c-4162-b7bd-897cdb61d2df tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:03.186272 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-cab1dd42-d55c-4162-b7bd-897cdb61d2df tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:03.197935 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cab1dd42-d55c-4162-b7bd-897cdb61d2df tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:03.199300 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cab1dd42-d55c-4162-b7bd-897cdb61d2df tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:03.200383 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cab1dd42-d55c-4162-b7bd-897cdb61d2df tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:03.200883 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cab1dd42-d55c-4162-b7bd-897cdb61d2df tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:03.385158 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-cab1dd42-d55c-4162-b7bd-897cdb61d2df tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:03.398406 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-cab1dd42-d55c-4162-b7bd-897cdb61d2df tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1313 microversion: 2.1 time: 0.227700 Jul 28 03:39:03.399227 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 149/270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:03 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:03.640291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d00e472d-5d78-4d0c-959e-60450c3e6d98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:03.641934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d00e472d-5d78-4d0c-959e-60450c3e6d98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:03.664270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d00e472d-5d78-4d0c-959e-60450c3e6d98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:03.664994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d00e472d-5d78-4d0c-959e-60450c3e6d98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:03.665936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d00e472d-5d78-4d0c-959e-60450c3e6d98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:03.666514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d00e472d-5d78-4d0c-959e-60450c3e6d98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:03.955078 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ac85318e-c945-47f3-946a-836a6635e7d3 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:03.956454 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ac85318e-c945-47f3-946a-836a6635e7d3 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:03.965744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d00e472d-5d78-4d0c-959e-60450c3e6d98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:03.993800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d00e472d-5d78-4d0c-959e-60450c3e6d98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:03.994311 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ac85318e-c945-47f3-946a-836a6635e7d3 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:03.995132 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ac85318e-c945-47f3-946a-836a6635e7d3 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:03.997386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d00e472d-5d78-4d0c-959e-60450c3e6d98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:03.998592 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ac85318e-c945-47f3-946a-836a6635e7d3 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:03.999309 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ac85318e-c945-47f3-946a-836a6635e7d3 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:04.002119 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d00e472d-5d78-4d0c-959e-60450c3e6d98 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.375300 Jul 28 03:39:04.009388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 122/271] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:03 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:04.228571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-40140047", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "networks": [{"uuid": "907c8c72-fbe1-4216-965a-39395c1cad68"}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:04.313311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] validate_networks() for [('907c8c72-fbe1-4216-965a-39395c1cad68', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:39:04.341632 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ac85318e-c945-47f3-946a-836a6635e7d3 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:04.350504 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ac85318e-c945-47f3-946a-836a6635e7d3 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.400048 Jul 28 03:39:04.351308 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 150/272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:03 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:04.415354 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-4524b8a4-0a08-4c7c-b85d-0d3b740b42b8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:04.415998 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-4524b8a4-0a08-4c7c-b85d-0d3b740b42b8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:04.426116 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4524b8a4-0a08-4c7c-b85d-0d3b740b42b8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:04.426834 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4524b8a4-0a08-4c7c-b85d-0d3b740b42b8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:04.427617 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4524b8a4-0a08-4c7c-b85d-0d3b740b42b8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:04.428076 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4524b8a4-0a08-4c7c-b85d-0d3b740b42b8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:04.647319 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-4524b8a4-0a08-4c7c-b85d-0d3b740b42b8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:04.657233 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-4524b8a4-0a08-4c7c-b85d-0d3b740b42b8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1313 microversion: 2.1 time: 0.245461 Jul 28 03:39:04.657912 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 151/273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:04 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:05.030591 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ab1785a7-6d0b-4c67-8906-8330227c8610 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:05.031211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:39:05.031732 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:39:05.032316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:39:05.032599 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ab1785a7-6d0b-4c67-8906-8330227c8610 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:05.032929 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:39:05.033441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:39:05.039064 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ab1785a7-6d0b-4c67-8906-8330227c8610 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:05.039920 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ab1785a7-6d0b-4c67-8906-8330227c8610 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:05.042016 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ab1785a7-6d0b-4c67-8906-8330227c8610 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:05.043426 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ab1785a7-6d0b-4c67-8906-8330227c8610 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:05.220694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:05.221141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:05.221934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:05.222547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:05.236349 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ab1785a7-6d0b-4c67-8906-8330227c8610 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:05.243003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Getting quotas for project da239fd2931445e6be6459a0225fbd85. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:39:05.247237 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ab1785a7-6d0b-4c67-8906-8330227c8610 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:05.248008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Getting quotas for user f3ecf43d42c74783a82bf45afd8826e8 and project da239fd2931445e6be6459a0225fbd85. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:39:05.250537 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ab1785a7-6d0b-4c67-8906-8330227c8610 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:05.252072 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ab1785a7-6d0b-4c67-8906-8330227c8610 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.226095 Jul 28 03:39:05.253198 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 152/274] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:05 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:05.264593 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:39:05.267031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:39:05.326397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-991fb8df-cccc-4035-a78e-33613ae8caab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.101486 Jul 28 03:39:05.327565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 123/275] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:39:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:39:05.338020 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8f9be2b2-6097-41c7-a55a-77522f44d4f7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:05.338837 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8f9be2b2-6097-41c7-a55a-77522f44d4f7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:05.368822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-448ab8fa-8338-4347-a1d4-4a348a6e8752 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:05.369518 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-448ab8fa-8338-4347-a1d4-4a348a6e8752 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:05.381827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-448ab8fa-8338-4347-a1d4-4a348a6e8752 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:05.382572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-448ab8fa-8338-4347-a1d4-4a348a6e8752 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:05.383932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-448ab8fa-8338-4347-a1d4-4a348a6e8752 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:05.384489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-448ab8fa-8338-4347-a1d4-4a348a6e8752 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:05.479181 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-8f9be2b2-6097-41c7-a55a-77522f44d4f7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:05.487217 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8f9be2b2-6097-41c7-a55a-77522f44d4f7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1216 microversion: 2.1 time: 0.153394 Jul 28 03:39:05.488070 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 153/276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:05 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:05.673596 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-85de59e6-1853-40c6-85f6-c5a839aaa689 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:05.674201 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-85de59e6-1853-40c6-85f6-c5a839aaa689 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:05.680589 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-85de59e6-1853-40c6-85f6-c5a839aaa689 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:05.681102 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-85de59e6-1853-40c6-85f6-c5a839aaa689 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:05.681891 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-85de59e6-1853-40c6-85f6-c5a839aaa689 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:05.682326 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-85de59e6-1853-40c6-85f6-c5a839aaa689 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:05.706538 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-448ab8fa-8338-4347-a1d4-4a348a6e8752 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:05.729242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-448ab8fa-8338-4347-a1d4-4a348a6e8752 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.360439 Jul 28 03:39:05.730444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 124/277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:05 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:05.914473 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-85de59e6-1853-40c6-85f6-c5a839aaa689 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:05.922637 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-85de59e6-1853-40c6-85f6-c5a839aaa689 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1313 microversion: 2.1 time: 0.252609 Jul 28 03:39:05.923189 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 154/278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:05 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:06.270276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-24edee80-25ff-4b11-9062-a0c00292962e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:06.271578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-24edee80-25ff-4b11-9062-a0c00292962e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:06.278378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24edee80-25ff-4b11-9062-a0c00292962e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:06.279099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24edee80-25ff-4b11-9062-a0c00292962e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:06.279991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24edee80-25ff-4b11-9062-a0c00292962e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:06.280568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24edee80-25ff-4b11-9062-a0c00292962e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:06.414567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-24edee80-25ff-4b11-9062-a0c00292962e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:06.423184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-24edee80-25ff-4b11-9062-a0c00292962e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:06.424731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-24edee80-25ff-4b11-9062-a0c00292962e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:06.425891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-24edee80-25ff-4b11-9062-a0c00292962e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.159341 Jul 28 03:39:06.426736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 125/279] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:06 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:06.506752 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-4d50ed15-d856-412b-a266-718d98cdf557 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:06.507691 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-4d50ed15-d856-412b-a266-718d98cdf557 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:06.514560 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4d50ed15-d856-412b-a266-718d98cdf557 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:06.515159 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4d50ed15-d856-412b-a266-718d98cdf557 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:06.516202 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4d50ed15-d856-412b-a266-718d98cdf557 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:06.516745 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4d50ed15-d856-412b-a266-718d98cdf557 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:06.605925 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-4d50ed15-d856-412b-a266-718d98cdf557 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:06.615825 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-4d50ed15-d856-412b-a266-718d98cdf557 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1268 microversion: 2.1 time: 0.114770 Jul 28 03:39:06.617242 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 155/280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:06 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1268 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:06.748178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2cd3aa7a-1ecf-4804-ac86-c1da46dd8a43 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:06.749754 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2cd3aa7a-1ecf-4804-ac86-c1da46dd8a43 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:06.757589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cd3aa7a-1ecf-4804-ac86-c1da46dd8a43 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:06.759289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cd3aa7a-1ecf-4804-ac86-c1da46dd8a43 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:06.760565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cd3aa7a-1ecf-4804-ac86-c1da46dd8a43 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:06.761983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cd3aa7a-1ecf-4804-ac86-c1da46dd8a43 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:06.939153 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-37c35ae8-f840-4a09-bb98-e03ce45a597f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:06.940014 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-37c35ae8-f840-4a09-bb98-e03ce45a597f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:06.950070 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-37c35ae8-f840-4a09-bb98-e03ce45a597f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:06.952846 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-37c35ae8-f840-4a09-bb98-e03ce45a597f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:06.953343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2cd3aa7a-1ecf-4804-ac86-c1da46dd8a43 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:06.954622 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-37c35ae8-f840-4a09-bb98-e03ce45a597f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:06.955071 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-37c35ae8-f840-4a09-bb98-e03ce45a597f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:06.963290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2cd3aa7a-1ecf-4804-ac86-c1da46dd8a43 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.221341 Jul 28 03:39:06.974609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 126/281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:06 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:07.264252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-37c35ae8-f840-4a09-bb98-e03ce45a597f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:07.274578 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-37c35ae8-f840-4a09-bb98-e03ce45a597f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1313 microversion: 2.1 time: 0.339025 Jul 28 03:39:07.275322 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 156/282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:06 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:07.446860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e8241b5e-8ab7-47cd-9857-75b46e462af5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:07.449283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e8241b5e-8ab7-47cd-9857-75b46e462af5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:07.457421 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8241b5e-8ab7-47cd-9857-75b46e462af5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:07.458499 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8241b5e-8ab7-47cd-9857-75b46e462af5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:07.459477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8241b5e-8ab7-47cd-9857-75b46e462af5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:07.460371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8241b5e-8ab7-47cd-9857-75b46e462af5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:07.632875 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-3d237394-e3c0-4a94-9da3-a8963b5db0f3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:07.634088 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-3d237394-e3c0-4a94-9da3-a8963b5db0f3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:07.645190 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3d237394-e3c0-4a94-9da3-a8963b5db0f3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:07.645894 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3d237394-e3c0-4a94-9da3-a8963b5db0f3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:07.648454 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3d237394-e3c0-4a94-9da3-a8963b5db0f3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:07.650575 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3d237394-e3c0-4a94-9da3-a8963b5db0f3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:07.682160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e8241b5e-8ab7-47cd-9857-75b46e462af5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:07.712853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e8241b5e-8ab7-47cd-9857-75b46e462af5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:07.715973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e8241b5e-8ab7-47cd-9857-75b46e462af5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:07.717540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e8241b5e-8ab7-47cd-9857-75b46e462af5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.276983 Jul 28 03:39:07.718141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 127/283] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:07 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:07.792066 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3d237394-e3c0-4a94-9da3-a8963b5db0f3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:07.804590 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-3d237394-e3c0-4a94-9da3-a8963b5db0f3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1274 microversion: 2.1 time: 0.172133 Jul 28 03:39:07.805416 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 157/284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:07 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:07.981740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-70ea64c7-f1d0-421c-a152-1b9b26d7a6fd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:07.983450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-70ea64c7-f1d0-421c-a152-1b9b26d7a6fd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:07.989898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-70ea64c7-f1d0-421c-a152-1b9b26d7a6fd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:07.990687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-70ea64c7-f1d0-421c-a152-1b9b26d7a6fd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:07.991701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-70ea64c7-f1d0-421c-a152-1b9b26d7a6fd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:07.992443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-70ea64c7-f1d0-421c-a152-1b9b26d7a6fd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:08.154794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-70ea64c7-f1d0-421c-a152-1b9b26d7a6fd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:08.163259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-70ea64c7-f1d0-421c-a152-1b9b26d7a6fd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.185397 Jul 28 03:39:08.164496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 128/285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:07 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:08.291045 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-4857c898-19af-4285-835c-f7cf11a62c14 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:08.291775 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-4857c898-19af-4285-835c-f7cf11a62c14 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:08.297878 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4857c898-19af-4285-835c-f7cf11a62c14 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:08.298416 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4857c898-19af-4285-835c-f7cf11a62c14 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:08.299273 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4857c898-19af-4285-835c-f7cf11a62c14 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:08.299851 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4857c898-19af-4285-835c-f7cf11a62c14 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:08.658709 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-4857c898-19af-4285-835c-f7cf11a62c14 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:08.670987 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-4857c898-19af-4285-835c-f7cf11a62c14 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1313 microversion: 2.1 time: 0.382689 Jul 28 03:39:08.672469 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 158/286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:08 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:08.739870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8e2e75db-c307-408a-bb5e-b9d392f57af8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:08.741031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8e2e75db-c307-408a-bb5e-b9d392f57af8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:08.752981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e2e75db-c307-408a-bb5e-b9d392f57af8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:08.753432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e2e75db-c307-408a-bb5e-b9d392f57af8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:08.754232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e2e75db-c307-408a-bb5e-b9d392f57af8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:08.754668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e2e75db-c307-408a-bb5e-b9d392f57af8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:08.821439 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c0c514b6-d0fd-43fc-a221-e028fd1d2f4b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:08.822553 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c0c514b6-d0fd-43fc-a221-e028fd1d2f4b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:08.829894 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c0c514b6-d0fd-43fc-a221-e028fd1d2f4b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:08.830565 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c0c514b6-d0fd-43fc-a221-e028fd1d2f4b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:08.831547 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c0c514b6-d0fd-43fc-a221-e028fd1d2f4b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:08.832964 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c0c514b6-d0fd-43fc-a221-e028fd1d2f4b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:08.965771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8e2e75db-c307-408a-bb5e-b9d392f57af8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:08.987292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8e2e75db-c307-408a-bb5e-b9d392f57af8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:08.988965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8e2e75db-c307-408a-bb5e-b9d392f57af8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:08.990891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8e2e75db-c307-408a-bb5e-b9d392f57af8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.257859 Jul 28 03:39:08.994991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 129/287] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:08 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:09.184158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f7408d7a-bac4-4ae0-ad27-0204d5d3667a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:09.184719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f7408d7a-bac4-4ae0-ad27-0204d5d3667a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:09.193212 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c0c514b6-d0fd-43fc-a221-e028fd1d2f4b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:09.205114 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c0c514b6-d0fd-43fc-a221-e028fd1d2f4b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1316 microversion: 2.1 time: 0.387352 Jul 28 03:39:09.207124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7408d7a-bac4-4ae0-ad27-0204d5d3667a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:09.217693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7408d7a-bac4-4ae0-ad27-0204d5d3667a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:09.218238 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 159/288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:08 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:09.219350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7408d7a-bac4-4ae0-ad27-0204d5d3667a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:09.220347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7408d7a-bac4-4ae0-ad27-0204d5d3667a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:09.393488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f7408d7a-bac4-4ae0-ad27-0204d5d3667a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:09.405294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f7408d7a-bac4-4ae0-ad27-0204d5d3667a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.228333 Jul 28 03:39:09.414775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 130/289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:09 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:09.606601 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-ab6181ca-cd2f-4764-b68f-f92fcceac7e2 req-91876ab9-1f2d-4412-930e-f5bf7af5a669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13f1d98-e65b-42e1-b39c-b225093adc02", "tag": "872503cb-9c95-418a-a479-b2ec51dd5555"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:09.609696 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:09.609696 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:39:09.625690 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-ab6181ca-cd2f-4764-b68f-f92fcceac7e2 req-91876ab9-1f2d-4412-930e-f5bf7af5a669 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:09.626182 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-ab6181ca-cd2f-4764-b68f-f92fcceac7e2 req-91876ab9-1f2d-4412-930e-f5bf7af5a669 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:09.651663 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-ab6181ca-cd2f-4764-b68f-f92fcceac7e2 req-91876ab9-1f2d-4412-930e-f5bf7af5a669 service nova] Creating event network-changed:872503cb-9c95-418a-a479-b2ec51dd5555 for instance a13f1d98-e65b-42e1-b39c-b225093adc02 on hv-cinder-73306 Jul 28 03:39:09.657600 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-ab6181ca-cd2f-4764-b68f-f92fcceac7e2 req-91876ab9-1f2d-4412-930e-f5bf7af5a669 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060725 Jul 28 03:39:09.672776 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 160/290] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:09.690152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0a5c765e-f746-40a3-91fb-4bb6ba7ac054 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:09.690928 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0a5c765e-f746-40a3-91fb-4bb6ba7ac054 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:09.697124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a5c765e-f746-40a3-91fb-4bb6ba7ac054 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:09.697562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a5c765e-f746-40a3-91fb-4bb6ba7ac054 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:09.699439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a5c765e-f746-40a3-91fb-4bb6ba7ac054 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:09.700050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a5c765e-f746-40a3-91fb-4bb6ba7ac054 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:09.871810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0a5c765e-f746-40a3-91fb-4bb6ba7ac054 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:09.883985 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0a5c765e-f746-40a3-91fb-4bb6ba7ac054 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1313 microversion: 2.1 time: 0.197274 Jul 28 03:39:09.884780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 131/291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:09 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:10.014242 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-cf79fcf3-3211-49cd-a895-4704066dbbf5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:10.015199 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-cf79fcf3-3211-49cd-a895-4704066dbbf5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:10.021580 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cf79fcf3-3211-49cd-a895-4704066dbbf5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:10.022219 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cf79fcf3-3211-49cd-a895-4704066dbbf5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:10.023151 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cf79fcf3-3211-49cd-a895-4704066dbbf5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:10.023770 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cf79fcf3-3211-49cd-a895-4704066dbbf5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:10.226292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-28bddf0e-a64f-476d-8eee-c54d1815e181 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:10.227180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-28bddf0e-a64f-476d-8eee-c54d1815e181 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:10.233576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28bddf0e-a64f-476d-8eee-c54d1815e181 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:10.235816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28bddf0e-a64f-476d-8eee-c54d1815e181 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:10.236761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28bddf0e-a64f-476d-8eee-c54d1815e181 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:10.237650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28bddf0e-a64f-476d-8eee-c54d1815e181 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:10.383573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-28bddf0e-a64f-476d-8eee-c54d1815e181 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:10.392216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-28bddf0e-a64f-476d-8eee-c54d1815e181 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1316 microversion: 2.1 time: 0.171148 Jul 28 03:39:10.393099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 132/292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:10 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:10.412645 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-cf79fcf3-3211-49cd-a895-4704066dbbf5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:10.422515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c9c8dd41-6827-4120-ab8a-c6a724a6ab24 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:10.423467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c9c8dd41-6827-4120-ab8a-c6a724a6ab24 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:10.434899 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-cf79fcf3-3211-49cd-a895-4704066dbbf5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:10.436947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9c8dd41-6827-4120-ab8a-c6a724a6ab24 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:10.437695 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9c8dd41-6827-4120-ab8a-c6a724a6ab24 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:10.438698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9c8dd41-6827-4120-ab8a-c6a724a6ab24 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:10.440692 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-cf79fcf3-3211-49cd-a895-4704066dbbf5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:10.441414 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9c8dd41-6827-4120-ab8a-c6a724a6ab24 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:10.445854 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-cf79fcf3-3211-49cd-a895-4704066dbbf5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.435673 Jul 28 03:39:10.447545 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 161/293] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:10 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:10.618766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c9c8dd41-6827-4120-ab8a-c6a724a6ab24 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:10.630580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c9c8dd41-6827-4120-ab8a-c6a724a6ab24 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.211927 Jul 28 03:39:10.632451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 133/294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:10 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:10.904228 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-88d4b02a-2425-4615-a6d7-9ec6f217fd9e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:10.905989 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-88d4b02a-2425-4615-a6d7-9ec6f217fd9e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:10.936476 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-88d4b02a-2425-4615-a6d7-9ec6f217fd9e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:10.937508 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-88d4b02a-2425-4615-a6d7-9ec6f217fd9e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:10.941489 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-88d4b02a-2425-4615-a6d7-9ec6f217fd9e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:10.943526 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-88d4b02a-2425-4615-a6d7-9ec6f217fd9e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:11.412738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1e99b8f3-1cfc-4bad-84ad-78b8aa45016c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:11.413981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1e99b8f3-1cfc-4bad-84ad-78b8aa45016c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:11.420941 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e99b8f3-1cfc-4bad-84ad-78b8aa45016c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:11.421643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e99b8f3-1cfc-4bad-84ad-78b8aa45016c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:11.422574 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e99b8f3-1cfc-4bad-84ad-78b8aa45016c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:11.423165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e99b8f3-1cfc-4bad-84ad-78b8aa45016c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:11.552661 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-88d4b02a-2425-4615-a6d7-9ec6f217fd9e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:11.565233 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-88d4b02a-2425-4615-a6d7-9ec6f217fd9e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1313 microversion: 2.1 time: 0.667124 Jul 28 03:39:11.575536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1e99b8f3-1cfc-4bad-84ad-78b8aa45016c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:11.578888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1e99b8f3-1cfc-4bad-84ad-78b8aa45016c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1316 microversion: 2.1 time: 0.171239 Jul 28 03:39:11.584550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 134/295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:11 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:11.585055 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 162/296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:10 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:11.585134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-9f2767a9-6657-412f-9acb-a1bd136ec1ea req-fda7f54f-3406-4d41-b5c7-23e261d71891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5b4e64-7b52-4fdf-bc58-56fce40dfc51", "name": "network-vif-plugged", "status": "completed", "tag": "ccaf035b-9463-4fa8-9a86-6365b8e3f28e"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:11.586122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:11.586122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:39:11.590399 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-3a3eb2c8-c52f-4830-87a6-e45358200f99 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:11.591042 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-3a3eb2c8-c52f-4830-87a6-e45358200f99 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:11.593765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-9f2767a9-6657-412f-9acb-a1bd136ec1ea req-fda7f54f-3406-4d41-b5c7-23e261d71891 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:11.594123 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-9f2767a9-6657-412f-9acb-a1bd136ec1ea req-fda7f54f-3406-4d41-b5c7-23e261d71891 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:11.611019 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3a3eb2c8-c52f-4830-87a6-e45358200f99 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:11.611480 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3a3eb2c8-c52f-4830-87a6-e45358200f99 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:11.614659 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3a3eb2c8-c52f-4830-87a6-e45358200f99 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:11.615546 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3a3eb2c8-c52f-4830-87a6-e45358200f99 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:11.617766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-9f2767a9-6657-412f-9acb-a1bd136ec1ea req-fda7f54f-3406-4d41-b5c7-23e261d71891 service nova] Creating event network-vif-plugged:ccaf035b-9463-4fa8-9a86-6365b8e3f28e for instance 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 on hv-cinder-73306 Jul 28 03:39:11.627617 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-9f2767a9-6657-412f-9acb-a1bd136ec1ea req-fda7f54f-3406-4d41-b5c7-23e261d71891 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046952 Jul 28 03:39:11.631795 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 135/297] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:11.650420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1e834fb3-c6b8-475f-bb72-4920a037ba92 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:11.651209 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1e834fb3-c6b8-475f-bb72-4920a037ba92 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:11.669483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e834fb3-c6b8-475f-bb72-4920a037ba92 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:11.670373 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e834fb3-c6b8-475f-bb72-4920a037ba92 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:11.671358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e834fb3-c6b8-475f-bb72-4920a037ba92 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:11.671985 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e834fb3-c6b8-475f-bb72-4920a037ba92 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:11.949250 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1e834fb3-c6b8-475f-bb72-4920a037ba92 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:11.966547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1e834fb3-c6b8-475f-bb72-4920a037ba92 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.319328 Jul 28 03:39:11.968173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 136/298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:11 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:11.978649 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3a3eb2c8-c52f-4830-87a6-e45358200f99 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:11.988067 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3a3eb2c8-c52f-4830-87a6-e45358200f99 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:11.990577 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3a3eb2c8-c52f-4830-87a6-e45358200f99 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:12.001199 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-3a3eb2c8-c52f-4830-87a6-e45358200f99 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.411234 Jul 28 03:39:12.002852 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 163/299] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:11 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:12.088606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c248fed2-9909-42dd-a377-075ea1ba9c80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:12.095247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c248fed2-9909-42dd-a377-075ea1ba9c80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:12.096044 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c248fed2-9909-42dd-a377-075ea1ba9c80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:12.183599 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c248fed2-9909-42dd-a377-075ea1ba9c80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Going to try to stop instance {{(pid=119154) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Jul 28 03:39:12.237961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c248fed2-9909-42dd-a377-075ea1ba9c80 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 202 len: 0 microversion: 2.1 time: 0.152526 Jul 28 03:39:12.242386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 137/300] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:39:12 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:39:12.250108 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d6b46d1c-178c-4ef1-b5f1-2feaa7a4fc58 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:12.251155 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d6b46d1c-178c-4ef1-b5f1-2feaa7a4fc58 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:12.260034 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d6b46d1c-178c-4ef1-b5f1-2feaa7a4fc58 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:12.260891 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d6b46d1c-178c-4ef1-b5f1-2feaa7a4fc58 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:12.262544 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d6b46d1c-178c-4ef1-b5f1-2feaa7a4fc58 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:12.263539 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d6b46d1c-178c-4ef1-b5f1-2feaa7a4fc58 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:12.497631 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d6b46d1c-178c-4ef1-b5f1-2feaa7a4fc58 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:12.508620 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d6b46d1c-178c-4ef1-b5f1-2feaa7a4fc58 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.264187 Jul 28 03:39:12.510217 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 164/301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:12 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:12.583974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3c818c5d-cce5-4526-bddb-1aecfa930f93 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:12.584679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3c818c5d-cce5-4526-bddb-1aecfa930f93 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:12.597446 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8507af83-979f-449f-928b-85c0c9671c49 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:12.598334 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8507af83-979f-449f-928b-85c0c9671c49 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:12.606205 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8507af83-979f-449f-928b-85c0c9671c49 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:12.606653 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8507af83-979f-449f-928b-85c0c9671c49 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:12.608991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3c818c5d-cce5-4526-bddb-1aecfa930f93 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:12.609684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3c818c5d-cce5-4526-bddb-1aecfa930f93 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:12.610879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3c818c5d-cce5-4526-bddb-1aecfa930f93 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:12.611454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3c818c5d-cce5-4526-bddb-1aecfa930f93 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:12.614520 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8507af83-979f-449f-928b-85c0c9671c49 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:12.615215 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8507af83-979f-449f-928b-85c0c9671c49 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:12.809647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3c818c5d-cce5-4526-bddb-1aecfa930f93 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:12.817884 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3c818c5d-cce5-4526-bddb-1aecfa930f93 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1313 microversion: 2.1 time: 0.239008 Jul 28 03:39:12.818481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 138/302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:12 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:12.919959 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-8507af83-979f-449f-928b-85c0c9671c49 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:12.927580 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8507af83-979f-449f-928b-85c0c9671c49 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1316 microversion: 2.1 time: 0.334765 Jul 28 03:39:12.928187 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 165/303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:12 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:12.988760 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-253bafe0-4eb0-4173-b027-2872a8edcbff tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:12.989557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-253bafe0-4eb0-4173-b027-2872a8edcbff tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:12.997051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-253bafe0-4eb0-4173-b027-2872a8edcbff tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:12.997622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-253bafe0-4eb0-4173-b027-2872a8edcbff tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:12.998483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-253bafe0-4eb0-4173-b027-2872a8edcbff tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:12.998982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-253bafe0-4eb0-4173-b027-2872a8edcbff tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:13.030268 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c21e3924-9a78-405f-9f72-2413b14e50d2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:13.031043 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c21e3924-9a78-405f-9f72-2413b14e50d2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:13.040034 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c21e3924-9a78-405f-9f72-2413b14e50d2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:13.040629 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c21e3924-9a78-405f-9f72-2413b14e50d2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:13.041514 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c21e3924-9a78-405f-9f72-2413b14e50d2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:13.042045 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c21e3924-9a78-405f-9f72-2413b14e50d2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:13.197069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-253bafe0-4eb0-4173-b027-2872a8edcbff tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:13.205753 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-253bafe0-4eb0-4173-b027-2872a8edcbff tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.225012 Jul 28 03:39:13.207519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 139/304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:12 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:13.375932 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c21e3924-9a78-405f-9f72-2413b14e50d2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:13.383559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c21e3924-9a78-405f-9f72-2413b14e50d2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:13.385071 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c21e3924-9a78-405f-9f72-2413b14e50d2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:13.386303 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c21e3924-9a78-405f-9f72-2413b14e50d2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.361978 Jul 28 03:39:13.387024 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 166/305] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:13 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:13.528948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3e8bd604-3b43-4b17-b49e-a74e4b9179cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:13.529556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3e8bd604-3b43-4b17-b49e-a74e4b9179cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:13.536344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3e8bd604-3b43-4b17-b49e-a74e4b9179cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:13.536791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3e8bd604-3b43-4b17-b49e-a74e4b9179cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:13.537617 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3e8bd604-3b43-4b17-b49e-a74e4b9179cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:13.538180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3e8bd604-3b43-4b17-b49e-a74e4b9179cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:13.702839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3e8bd604-3b43-4b17-b49e-a74e4b9179cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:13.724768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3e8bd604-3b43-4b17-b49e-a74e4b9179cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.200453 Jul 28 03:39:13.725933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 140/306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:13 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:13.836254 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c4cfb6cf-7503-4100-810d-26030b9ea22f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:13.837146 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c4cfb6cf-7503-4100-810d-26030b9ea22f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:13.844462 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c4cfb6cf-7503-4100-810d-26030b9ea22f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:13.845481 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c4cfb6cf-7503-4100-810d-26030b9ea22f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:13.846493 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c4cfb6cf-7503-4100-810d-26030b9ea22f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:13.847187 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c4cfb6cf-7503-4100-810d-26030b9ea22f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:13.947780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b7ad8b39-78a8-45f4-b47e-faccb738de6d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:13.950487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b7ad8b39-78a8-45f4-b47e-faccb738de6d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:13.958917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7ad8b39-78a8-45f4-b47e-faccb738de6d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:13.959779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7ad8b39-78a8-45f4-b47e-faccb738de6d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:13.960810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7ad8b39-78a8-45f4-b47e-faccb738de6d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:13.961989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7ad8b39-78a8-45f4-b47e-faccb738de6d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:14.060065 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c4cfb6cf-7503-4100-810d-26030b9ea22f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:14.069073 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c4cfb6cf-7503-4100-810d-26030b9ea22f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1313 microversion: 2.1 time: 0.236912 Jul 28 03:39:14.080251 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 167/307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:13 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:14.147971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b7ad8b39-78a8-45f4-b47e-faccb738de6d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:14.160762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b7ad8b39-78a8-45f4-b47e-faccb738de6d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1316 microversion: 2.1 time: 0.219251 Jul 28 03:39:14.173785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 141/308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:13 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:14.225853 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5cb1ed79-9942-4201-92cb-d792735a69b6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:14.226731 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5cb1ed79-9942-4201-92cb-d792735a69b6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:14.247979 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cb1ed79-9942-4201-92cb-d792735a69b6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:14.248685 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cb1ed79-9942-4201-92cb-d792735a69b6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:14.251357 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cb1ed79-9942-4201-92cb-d792735a69b6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:14.252236 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cb1ed79-9942-4201-92cb-d792735a69b6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:14.419040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-98d7fd84-2704-4dce-9258-59d267aae34a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:14.420088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-98d7fd84-2704-4dce-9258-59d267aae34a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:14.426447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98d7fd84-2704-4dce-9258-59d267aae34a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:14.427170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98d7fd84-2704-4dce-9258-59d267aae34a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:14.428394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98d7fd84-2704-4dce-9258-59d267aae34a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:14.428978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98d7fd84-2704-4dce-9258-59d267aae34a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:14.613083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-98d7fd84-2704-4dce-9258-59d267aae34a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:14.624707 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-98d7fd84-2704-4dce-9258-59d267aae34a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:14.627308 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-98d7fd84-2704-4dce-9258-59d267aae34a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:14.628751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-98d7fd84-2704-4dce-9258-59d267aae34a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.227099 Jul 28 03:39:14.631465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 142/309] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:14 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:14.742129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1938e413-55e9-44c6-b0ba-34347c7488f7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:14.742766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1938e413-55e9-44c6-b0ba-34347c7488f7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:14.749491 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1938e413-55e9-44c6-b0ba-34347c7488f7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:14.750051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1938e413-55e9-44c6-b0ba-34347c7488f7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:14.750892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1938e413-55e9-44c6-b0ba-34347c7488f7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:14.751421 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1938e413-55e9-44c6-b0ba-34347c7488f7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:14.787809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5cb1ed79-9942-4201-92cb-d792735a69b6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:14.796877 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5cb1ed79-9942-4201-92cb-d792735a69b6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.576765 Jul 28 03:39:14.797662 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 168/310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:14 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:14.894628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1938e413-55e9-44c6-b0ba-34347c7488f7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:14.903404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1938e413-55e9-44c6-b0ba-34347c7488f7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.164926 Jul 28 03:39:14.904470 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 143/311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:14 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:15.098314 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f5dfffa3-56f0-43bc-86f5-86c1572fb814 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:15.099752 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f5dfffa3-56f0-43bc-86f5-86c1572fb814 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:15.110525 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f5dfffa3-56f0-43bc-86f5-86c1572fb814 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:15.113107 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f5dfffa3-56f0-43bc-86f5-86c1572fb814 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:15.114494 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f5dfffa3-56f0-43bc-86f5-86c1572fb814 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:15.115035 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f5dfffa3-56f0-43bc-86f5-86c1572fb814 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:15.179458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2f48a3fe-467e-42ec-8b3a-5c1e0cd2910e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:15.180049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2f48a3fe-467e-42ec-8b3a-5c1e0cd2910e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:15.186008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f48a3fe-467e-42ec-8b3a-5c1e0cd2910e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:15.186504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f48a3fe-467e-42ec-8b3a-5c1e0cd2910e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:15.187578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f48a3fe-467e-42ec-8b3a-5c1e0cd2910e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:15.188035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f48a3fe-467e-42ec-8b3a-5c1e0cd2910e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:15.320791 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f5dfffa3-56f0-43bc-86f5-86c1572fb814 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:15.325723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2f48a3fe-467e-42ec-8b3a-5c1e0cd2910e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:15.330618 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f5dfffa3-56f0-43bc-86f5-86c1572fb814 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1497 microversion: 2.1 time: 0.239707 Jul 28 03:39:15.331735 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 169/312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:15 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1497 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:15.333496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2f48a3fe-467e-42ec-8b3a-5c1e0cd2910e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1316 microversion: 2.1 time: 0.159004 Jul 28 03:39:15.343376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 144/313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:15 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:15.653426 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-42726cc1-32f1-4c1a-b41e-23953ed2cb29 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:15.654758 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-42726cc1-32f1-4c1a-b41e-23953ed2cb29 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:15.667753 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-42726cc1-32f1-4c1a-b41e-23953ed2cb29 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:15.668243 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-42726cc1-32f1-4c1a-b41e-23953ed2cb29 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:15.669306 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-42726cc1-32f1-4c1a-b41e-23953ed2cb29 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:15.669753 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-42726cc1-32f1-4c1a-b41e-23953ed2cb29 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:15.817247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bea20474-6eae-439b-9a6e-a13464aacb46 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:15.819454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bea20474-6eae-439b-9a6e-a13464aacb46 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:15.827041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bea20474-6eae-439b-9a6e-a13464aacb46 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:15.827804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bea20474-6eae-439b-9a6e-a13464aacb46 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:15.829225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bea20474-6eae-439b-9a6e-a13464aacb46 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:15.829865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bea20474-6eae-439b-9a6e-a13464aacb46 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:15.957039 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-42726cc1-32f1-4c1a-b41e-23953ed2cb29 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:15.970443 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-42726cc1-32f1-4c1a-b41e-23953ed2cb29 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:15.972293 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-42726cc1-32f1-4c1a-b41e-23953ed2cb29 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:15.973683 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-42726cc1-32f1-4c1a-b41e-23953ed2cb29 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.331014 Jul 28 03:39:15.974755 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 170/314] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:15 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:15.979617 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2d3a700a-c7a2-421b-b7d5-4f3873011e00 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:15.980711 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2d3a700a-c7a2-421b-b7d5-4f3873011e00 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:15.992036 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d3a700a-c7a2-421b-b7d5-4f3873011e00 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:15.993005 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d3a700a-c7a2-421b-b7d5-4f3873011e00 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:15.993974 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d3a700a-c7a2-421b-b7d5-4f3873011e00 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:15.994594 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d3a700a-c7a2-421b-b7d5-4f3873011e00 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:16.055977 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bea20474-6eae-439b-9a6e-a13464aacb46 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:16.070386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bea20474-6eae-439b-9a6e-a13464aacb46 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.260116 Jul 28 03:39:16.076681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 145/315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:15 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:16.177158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4f7ba21d-5de6-4574-af42-19a409aadc3b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:16.182597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4f7ba21d-5de6-4574-af42-19a409aadc3b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:16.189613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4f7ba21d-5de6-4574-af42-19a409aadc3b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:16.190342 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4f7ba21d-5de6-4574-af42-19a409aadc3b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:16.191333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4f7ba21d-5de6-4574-af42-19a409aadc3b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:16.191799 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4f7ba21d-5de6-4574-af42-19a409aadc3b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:16.218935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4f7ba21d-5de6-4574-af42-19a409aadc3b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:39:16.343027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4f7ba21d-5de6-4574-af42-19a409aadc3b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 204 len: 0 microversion: 2.1 time: 0.172298 Jul 28 03:39:16.344004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 146/316] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:39:16 2021] DELETE /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:39:16.355137 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a925851c-9a18-48b7-bb62-860b7ffa4674 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:16.356835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a925851c-9a18-48b7-bb62-860b7ffa4674 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:16.363702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a925851c-9a18-48b7-bb62-860b7ffa4674 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:16.364526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a925851c-9a18-48b7-bb62-860b7ffa4674 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:16.366326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a925851c-9a18-48b7-bb62-860b7ffa4674 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:16.367175 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a925851c-9a18-48b7-bb62-860b7ffa4674 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:16.412452 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-2d3a700a-c7a2-421b-b7d5-4f3873011e00 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:16.422453 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2d3a700a-c7a2-421b-b7d5-4f3873011e00 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.446387 Jul 28 03:39:16.423398 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 171/317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:15 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:16.447752 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b630f705-2d96-42f2-bdd2-be4c4cef5eda tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:16.449430 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b630f705-2d96-42f2-bdd2-be4c4cef5eda tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:16.456106 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b630f705-2d96-42f2-bdd2-be4c4cef5eda tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:16.458488 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b630f705-2d96-42f2-bdd2-be4c4cef5eda tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:16.459700 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b630f705-2d96-42f2-bdd2-be4c4cef5eda tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:16.460972 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b630f705-2d96-42f2-bdd2-be4c4cef5eda tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:16.535978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a925851c-9a18-48b7-bb62-860b7ffa4674 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:16.547194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a925851c-9a18-48b7-bb62-860b7ffa4674 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1503 microversion: 2.1 time: 0.196213 Jul 28 03:39:16.548158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 147/318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:16 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:16.619609 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b630f705-2d96-42f2-bdd2-be4c4cef5eda tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:16.628810 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b630f705-2d96-42f2-bdd2-be4c4cef5eda tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1316 microversion: 2.1 time: 0.204078 Jul 28 03:39:16.629569 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 172/319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:16 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:16.767481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-93ab8a7b-20d6-4713-b128-8999604b33ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Action: 'create', calling method: .version_select at 0x7f6806a78430>, body: {"keypair": {"name": "tempest-TestShelveInstance-450332115"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:16.784460 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-93ab8a7b-20d6-4713-b128-8999604b33ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Getting quotas for project dcfeb19e3a6d42cfbf29ba7e9a7aeacf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:39:16.788165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-93ab8a7b-20d6-4713-b128-8999604b33ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Getting quotas for user b539456ade66487fabf02e41879bbb45 and project dcfeb19e3a6d42cfbf29ba7e9a7aeacf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:39:16.966617 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-93ab8a7b-20d6-4713-b128-8999604b33ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Getting quotas for project dcfeb19e3a6d42cfbf29ba7e9a7aeacf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:39:16.970518 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-93ab8a7b-20d6-4713-b128-8999604b33ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Getting quotas for user b539456ade66487fabf02e41879bbb45 and project dcfeb19e3a6d42cfbf29ba7e9a7aeacf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:39:16.983480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-93ab8a7b-20d6-4713-b128-8999604b33ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.385163 Jul 28 03:39:16.984113 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 148/320] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jul 28 03:39:16 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:16.991674 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1f4833e8-a71f-4ac4-8044-bde5e63355ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:16.992337 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1f4833e8-a71f-4ac4-8044-bde5e63355ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:16.998875 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1f4833e8-a71f-4ac4-8044-bde5e63355ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:16.999330 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1f4833e8-a71f-4ac4-8044-bde5e63355ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.000163 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1f4833e8-a71f-4ac4-8044-bde5e63355ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:17.000603 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1f4833e8-a71f-4ac4-8044-bde5e63355ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.094589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e4178439-6071-46b4-9270-4c35bb17be74 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:17.095926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e4178439-6071-46b4-9270-4c35bb17be74 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:17.102314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4178439-6071-46b4-9270-4c35bb17be74 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:17.102773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4178439-6071-46b4-9270-4c35bb17be74 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.103963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4178439-6071-46b4-9270-4c35bb17be74 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:17.105297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4178439-6071-46b4-9270-4c35bb17be74 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.193699 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1f4833e8-a71f-4ac4-8044-bde5e63355ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:17.206562 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1f4833e8-a71f-4ac4-8044-bde5e63355ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:17.208624 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1f4833e8-a71f-4ac4-8044-bde5e63355ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:17.223657 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1f4833e8-a71f-4ac4-8044-bde5e63355ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.235538 Jul 28 03:39:17.225046 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 173/321] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:16 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:17.241281 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-a47daee0-70cf-46df-907c-c7f2b699b503 req-c9b9abbf-ba8d-494b-b3ed-5cf0e18b3c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13f1d98-e65b-42e1-b39c-b225093adc02", "name": "network-vif-plugged", "status": "completed", "tag": "872503cb-9c95-418a-a479-b2ec51dd5555"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:17.243390 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:17.243390 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:39:17.267557 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-a47daee0-70cf-46df-907c-c7f2b699b503 req-c9b9abbf-ba8d-494b-b3ed-5cf0e18b3c42 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:17.268089 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-a47daee0-70cf-46df-907c-c7f2b699b503 req-c9b9abbf-ba8d-494b-b3ed-5cf0e18b3c42 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.282892 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-a47daee0-70cf-46df-907c-c7f2b699b503 req-c9b9abbf-ba8d-494b-b3ed-5cf0e18b3c42 service nova] Creating event network-vif-plugged:872503cb-9c95-418a-a479-b2ec51dd5555 for instance a13f1d98-e65b-42e1-b39c-b225093adc02 on hv-cinder-73306 Jul 28 03:39:17.289220 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-a47daee0-70cf-46df-907c-c7f2b699b503 req-c9b9abbf-ba8d-494b-b3ed-5cf0e18b3c42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052573 Jul 28 03:39:17.290348 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 174/322] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:17.296042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e4178439-6071-46b4-9270-4c35bb17be74 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:17.306041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e4178439-6071-46b4-9270-4c35bb17be74 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.216872 Jul 28 03:39:17.315733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 149/323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:17 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:17.441239 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0fe9b1e8-4c25-4f54-9690-050a0569cf9d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:17.442659 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0fe9b1e8-4c25-4f54-9690-050a0569cf9d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:17.450721 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0fe9b1e8-4c25-4f54-9690-050a0569cf9d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:17.451249 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0fe9b1e8-4c25-4f54-9690-050a0569cf9d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.452128 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0fe9b1e8-4c25-4f54-9690-050a0569cf9d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:17.452556 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0fe9b1e8-4c25-4f54-9690-050a0569cf9d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.564565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-86a1cfe4-abd6-42f9-a5c7-1880f62b8f4d tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:17.565179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-86a1cfe4-abd6-42f9-a5c7-1880f62b8f4d tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:17.578189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-86a1cfe4-abd6-42f9-a5c7-1880f62b8f4d tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:17.578637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-86a1cfe4-abd6-42f9-a5c7-1880f62b8f4d tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.580474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-86a1cfe4-abd6-42f9-a5c7-1880f62b8f4d tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:17.580910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-86a1cfe4-abd6-42f9-a5c7-1880f62b8f4d tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.725678 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0fe9b1e8-4c25-4f54-9690-050a0569cf9d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:17.726478 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-86a1cfe4-abd6-42f9-a5c7-1880f62b8f4d tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:17.737259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-86a1cfe4-abd6-42f9-a5c7-1880f62b8f4d tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1503 microversion: 2.1 time: 0.176214 Jul 28 03:39:17.740224 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 150/324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:17 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:17.748013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e4af8aa1-934a-4272-8b86-1f5cbc920ef2 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:17.748935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e4af8aa1-934a-4272-8b86-1f5cbc920ef2 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:17.749096 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0fe9b1e8-4c25-4f54-9690-050a0569cf9d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.303330 Jul 28 03:39:17.749761 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 175/325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:17 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:17.755784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4af8aa1-934a-4272-8b86-1f5cbc920ef2 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:17.756413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4af8aa1-934a-4272-8b86-1f5cbc920ef2 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.757685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4af8aa1-934a-4272-8b86-1f5cbc920ef2 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:17.757685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4af8aa1-934a-4272-8b86-1f5cbc920ef2 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:17.941204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e4af8aa1-934a-4272-8b86-1f5cbc920ef2 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:17.953207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e4af8aa1-934a-4272-8b86-1f5cbc920ef2 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1316 microversion: 2.1 time: 0.210849 Jul 28 03:39:17.953997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 151/326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:17 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:18.242123 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0c61551b-028e-44bf-a096-738f06213361 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:18.242858 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0c61551b-028e-44bf-a096-738f06213361 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:18.249161 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0c61551b-028e-44bf-a096-738f06213361 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:18.249614 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0c61551b-028e-44bf-a096-738f06213361 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:18.250388 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0c61551b-028e-44bf-a096-738f06213361 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:18.250824 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0c61551b-028e-44bf-a096-738f06213361 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:18.321961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f39f3728-3d22-473d-bb07-529404362751 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:18.322578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f39f3728-3d22-473d-bb07-529404362751 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:18.329372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f39f3728-3d22-473d-bb07-529404362751 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:18.329829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f39f3728-3d22-473d-bb07-529404362751 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:18.330624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f39f3728-3d22-473d-bb07-529404362751 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:18.331140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f39f3728-3d22-473d-bb07-529404362751 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:18.410634 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0c61551b-028e-44bf-a096-738f06213361 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:18.419143 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0c61551b-028e-44bf-a096-738f06213361 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:18.420673 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0c61551b-028e-44bf-a096-738f06213361 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:18.421818 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0c61551b-028e-44bf-a096-738f06213361 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.183404 Jul 28 03:39:18.422376 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 176/327] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:18 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:18.489723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f39f3728-3d22-473d-bb07-529404362751 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:18.498110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f39f3728-3d22-473d-bb07-529404362751 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.179653 Jul 28 03:39:18.498688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 152/328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:18 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:18.756154 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c0e377cc-ebcf-4f42-b3ac-6ab324beab15 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:18.756750 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c0e377cc-ebcf-4f42-b3ac-6ab324beab15 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:18.767107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f7e468bd-cc81-42ad-861a-f7a9719bfe6f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:18.767746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f7e468bd-cc81-42ad-861a-f7a9719bfe6f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:18.772596 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c0e377cc-ebcf-4f42-b3ac-6ab324beab15 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:18.773037 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c0e377cc-ebcf-4f42-b3ac-6ab324beab15 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:18.773805 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c0e377cc-ebcf-4f42-b3ac-6ab324beab15 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:18.774231 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c0e377cc-ebcf-4f42-b3ac-6ab324beab15 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:18.780713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7e468bd-cc81-42ad-861a-f7a9719bfe6f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:18.781172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7e468bd-cc81-42ad-861a-f7a9719bfe6f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:18.781944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7e468bd-cc81-42ad-861a-f7a9719bfe6f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:18.782377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7e468bd-cc81-42ad-861a-f7a9719bfe6f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:18.926558 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c0e377cc-ebcf-4f42-b3ac-6ab324beab15 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:18.933980 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f7e468bd-cc81-42ad-861a-f7a9719bfe6f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:18.934528 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c0e377cc-ebcf-4f42-b3ac-6ab324beab15 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1503 microversion: 2.1 time: 0.182077 Jul 28 03:39:18.935095 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 177/329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:18 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:18.942244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f7e468bd-cc81-42ad-861a-f7a9719bfe6f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.179387 Jul 28 03:39:18.942902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 153/330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:18 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:18.970071 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0ad6ac94-50a9-4d99-9cf6-176078510a3c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:18.970682 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0ad6ac94-50a9-4d99-9cf6-176078510a3c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:18.976534 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0ad6ac94-50a9-4d99-9cf6-176078510a3c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:18.976982 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0ad6ac94-50a9-4d99-9cf6-176078510a3c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:18.977751 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0ad6ac94-50a9-4d99-9cf6-176078510a3c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:18.978185 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0ad6ac94-50a9-4d99-9cf6-176078510a3c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:19.191614 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0ad6ac94-50a9-4d99-9cf6-176078510a3c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:19.199809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0ad6ac94-50a9-4d99-9cf6-176078510a3c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1316 microversion: 2.1 time: 0.233527 Jul 28 03:39:19.200307 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 178/331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:18 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:19.440286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a4b2dff2-68a1-43a2-b33f-23c08a3b9374 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:19.441554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a4b2dff2-68a1-43a2-b33f-23c08a3b9374 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:19.448973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4b2dff2-68a1-43a2-b33f-23c08a3b9374 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:19.450029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4b2dff2-68a1-43a2-b33f-23c08a3b9374 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:19.451060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4b2dff2-68a1-43a2-b33f-23c08a3b9374 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:19.451738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4b2dff2-68a1-43a2-b33f-23c08a3b9374 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:19.519085 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7a9e76e5-b4fa-4531-8d1e-0f4679281026 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:19.520477 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-7a9e76e5-b4fa-4531-8d1e-0f4679281026 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:19.536003 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7a9e76e5-b4fa-4531-8d1e-0f4679281026 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:19.538108 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7a9e76e5-b4fa-4531-8d1e-0f4679281026 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:19.538538 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7a9e76e5-b4fa-4531-8d1e-0f4679281026 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:19.540843 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7a9e76e5-b4fa-4531-8d1e-0f4679281026 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:19.669312 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4b2dff2-68a1-43a2-b33f-23c08a3b9374 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:19.680629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4b2dff2-68a1-43a2-b33f-23c08a3b9374 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:19.685089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4b2dff2-68a1-43a2-b33f-23c08a3b9374 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:19.688158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a4b2dff2-68a1-43a2-b33f-23c08a3b9374 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.250304 Jul 28 03:39:19.690457 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 154/332] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:19 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:19.927445 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-7a9e76e5-b4fa-4531-8d1e-0f4679281026 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:19.931494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-e5339696-af88-418d-aa80-4fd759726499 req-18c7b884-ca14-4eb2-94a8-fa3e37c17d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5b4e64-7b52-4fdf-bc58-56fce40dfc51", "name": "network-vif-deleted", "tag": "ccaf035b-9463-4fa8-9a86-6365b8e3f28e"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:19.937520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:19.937520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:39:19.940564 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-7a9e76e5-b4fa-4531-8d1e-0f4679281026 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.426629 Jul 28 03:39:19.948179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-e5339696-af88-418d-aa80-4fd759726499 req-18c7b884-ca14-4eb2-94a8-fa3e37c17d22 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:19.949416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-e5339696-af88-418d-aa80-4fd759726499 req-18c7b884-ca14-4eb2-94a8-fa3e37c17d22 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:19.950342 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 179/333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:19 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:19.957811 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-524c2b66-2649-41f1-901a-7e38611d44ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:19.958628 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-524c2b66-2649-41f1-901a-7e38611d44ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:19.966050 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-524c2b66-2649-41f1-901a-7e38611d44ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:19.966630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-e5339696-af88-418d-aa80-4fd759726499 req-18c7b884-ca14-4eb2-94a8-fa3e37c17d22 service nova] Creating event network-vif-deleted:ccaf035b-9463-4fa8-9a86-6365b8e3f28e for instance 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 on hv-cinder-73306 Jul 28 03:39:19.967177 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-524c2b66-2649-41f1-901a-7e38611d44ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:19.968616 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-524c2b66-2649-41f1-901a-7e38611d44ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:19.969238 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-524c2b66-2649-41f1-901a-7e38611d44ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:19.972139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-e5339696-af88-418d-aa80-4fd759726499 req-18c7b884-ca14-4eb2-94a8-fa3e37c17d22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049338 Jul 28 03:39:19.972725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 155/334] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:19.980604 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f4a0e096-85ed-49eb-b8eb-bfce757b4737 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:19.981464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f4a0e096-85ed-49eb-b8eb-bfce757b4737 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:19.987966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4a0e096-85ed-49eb-b8eb-bfce757b4737 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:19.988566 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4a0e096-85ed-49eb-b8eb-bfce757b4737 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:19.989206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4a0e096-85ed-49eb-b8eb-bfce757b4737 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:19.989846 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4a0e096-85ed-49eb-b8eb-bfce757b4737 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:20.053649 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-524c2b66-2649-41f1-901a-7e38611d44ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:20.061607 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-524c2b66-2649-41f1-901a-7e38611d44ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 200 len: 1298 microversion: 2.1 time: 0.110029 Jul 28 03:39:20.072434 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 180/335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:19 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:20.154043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f4a0e096-85ed-49eb-b8eb-bfce757b4737 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:20.163850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f4a0e096-85ed-49eb-b8eb-bfce757b4737 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.188642 Jul 28 03:39:20.164765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 156/336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:19 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:20.216208 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-98ac1ded-b9ce-49d2-a970-9e998304ff71 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:20.216774 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-98ac1ded-b9ce-49d2-a970-9e998304ff71 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:20.223160 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-98ac1ded-b9ce-49d2-a970-9e998304ff71 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:20.223611 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-98ac1ded-b9ce-49d2-a970-9e998304ff71 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:20.224424 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-98ac1ded-b9ce-49d2-a970-9e998304ff71 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:20.224866 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-98ac1ded-b9ce-49d2-a970-9e998304ff71 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:20.364923 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-98ac1ded-b9ce-49d2-a970-9e998304ff71 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:20.372853 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-98ac1ded-b9ce-49d2-a970-9e998304ff71 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1505 microversion: 2.1 time: 0.160426 Jul 28 03:39:20.373413 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 181/337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:20 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:20.710505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dcf51895-ab8f-4ffa-b8fe-57f007d864de tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:20.711216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dcf51895-ab8f-4ffa-b8fe-57f007d864de tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:20.718513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcf51895-ab8f-4ffa-b8fe-57f007d864de tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:20.718974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcf51895-ab8f-4ffa-b8fe-57f007d864de tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:20.720201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcf51895-ab8f-4ffa-b8fe-57f007d864de tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:20.720706 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcf51895-ab8f-4ffa-b8fe-57f007d864de tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:20.897332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dcf51895-ab8f-4ffa-b8fe-57f007d864de tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:20.915406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dcf51895-ab8f-4ffa-b8fe-57f007d864de tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:20.917724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dcf51895-ab8f-4ffa-b8fe-57f007d864de tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:20.919613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dcf51895-ab8f-4ffa-b8fe-57f007d864de tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.214892 Jul 28 03:39:20.920597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 157/338] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:20 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:20.958028 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-cd4fefba-727c-4a8f-88a6-28c9a615cb8e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:20.959095 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-cd4fefba-727c-4a8f-88a6-28c9a615cb8e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:20.967178 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cd4fefba-727c-4a8f-88a6-28c9a615cb8e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:20.967631 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cd4fefba-727c-4a8f-88a6-28c9a615cb8e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:20.968662 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cd4fefba-727c-4a8f-88a6-28c9a615cb8e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:20.969258 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cd4fefba-727c-4a8f-88a6-28c9a615cb8e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:21.079169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-17016a9a-670d-47bd-97fd-72cf98d3b6a0 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:21.079818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-17016a9a-670d-47bd-97fd-72cf98d3b6a0 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:21.086512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17016a9a-670d-47bd-97fd-72cf98d3b6a0 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:21.087067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17016a9a-670d-47bd-97fd-72cf98d3b6a0 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:21.087985 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17016a9a-670d-47bd-97fd-72cf98d3b6a0 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:21.088497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17016a9a-670d-47bd-97fd-72cf98d3b6a0 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:21.115688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-17016a9a-670d-47bd-97fd-72cf98d3b6a0 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] HTTP exception thrown: Instance 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 could not be found. Jul 28 03:39:21.116338 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-17016a9a-670d-47bd-97fd-72cf98d3b6a0 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Returning 404 to user: Instance 1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:39:21.117181 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-17016a9a-670d-47bd-97fd-72cf98d3b6a0 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51" status: 404 len: 111 microversion: 2.1 time: 0.041755 Jul 28 03:39:21.117894 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 158/339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:21 2021] GET /compute/v2.1/servers/1f5b4e64-7b52-4fdf-bc58-56fce40dfc51 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:39:21.147062 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-cd4fefba-727c-4a8f-88a6-28c9a615cb8e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:21.156213 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-cd4fefba-727c-4a8f-88a6-28c9a615cb8e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.201980 Jul 28 03:39:21.157325 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 182/340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:20 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:21.182482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f79cc037-a26d-4abf-acaa-e7541c8f2f99 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:21.184646 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f79cc037-a26d-4abf-acaa-e7541c8f2f99 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:21.190894 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f79cc037-a26d-4abf-acaa-e7541c8f2f99 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:21.191585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f79cc037-a26d-4abf-acaa-e7541c8f2f99 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:21.192402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f79cc037-a26d-4abf-acaa-e7541c8f2f99 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:21.192836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f79cc037-a26d-4abf-acaa-e7541c8f2f99 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:21.247503 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1308374826", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "networks": [{"uuid": "70ad9fef-d2a8-4a68-a9fa-5f970fad1121"}]}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:21.318113 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.network.neutron [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] validate_networks() for [('70ad9fef-d2a8-4a68-a9fa-5f970fad1121', None, None, None)] {{(pid=119155) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:39:21.333080 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f79cc037-a26d-4abf-acaa-e7541c8f2f99 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:21.341430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f79cc037-a26d-4abf-acaa-e7541c8f2f99 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.163080 Jul 28 03:39:21.342014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 159/341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:21 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:21.765039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4ffa6fb2-b1ed-4c70-b0ff-b5b025d0a1ba tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5b5be43-f404-4886-ae1e-bbba27ad74fa"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:21.766105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4ffa6fb2-b1ed-4c70-b0ff-b5b025d0a1ba tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:21.776344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ffa6fb2-b1ed-4c70-b0ff-b5b025d0a1ba tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:21.777045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ffa6fb2-b1ed-4c70-b0ff-b5b025d0a1ba tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:21.778155 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ffa6fb2-b1ed-4c70-b0ff-b5b025d0a1ba tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:21.778768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ffa6fb2-b1ed-4c70-b0ff-b5b025d0a1ba tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:22.133956 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Flavor limits 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:39:22.135147 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Image limits 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:39:22.135930 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Flavor pref 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:39:22.136843 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Image pref 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:39:22.137261 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:39:22.142610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4ffa6fb2-b1ed-4c70-b0ff-b5b025d0a1ba tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "POST /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382370 Jul 28 03:39:22.143360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 160/342] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 03:39:21 2021] POST /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:39:22.157136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e1bd906e-5be8-47c9-983e-ec051ec6f50f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:22.159877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e1bd906e-5be8-47c9-983e-ec051ec6f50f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:22.166123 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:22.169678 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:22.170944 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:22.171649 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:22.173290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e1bd906e-5be8-47c9-983e-ec051ec6f50f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:22.173772 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e1bd906e-5be8-47c9-983e-ec051ec6f50f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:22.174561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e1bd906e-5be8-47c9-983e-ec051ec6f50f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:22.175022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e1bd906e-5be8-47c9-983e-ec051ec6f50f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:22.331309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e1bd906e-5be8-47c9-983e-ec051ec6f50f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:22.340929 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e1bd906e-5be8-47c9-983e-ec051ec6f50f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:22.342425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e1bd906e-5be8-47c9-983e-ec051ec6f50f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:22.343556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e1bd906e-5be8-47c9-983e-ec051ec6f50f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.199007 Jul 28 03:39:22.344137 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 161/343] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:22 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:22.346521 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.quota [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Getting quotas for project 390a8b33f669478db43fb9ad4259eccb. Resources: {'ram', 'cores', 'instances'} {{(pid=119155) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:39:22.348936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-717e8573-0026-4506-adb7-4a25580d942d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:22.349680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-717e8573-0026-4506-adb7-4a25580d942d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:22.350415 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.quota [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Getting quotas for user 0db58e38f88a4965a94d51882db44960 and project 390a8b33f669478db43fb9ad4259eccb. Resources: {'ram', 'cores', 'instances'} {{(pid=119155) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:39:22.356733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-717e8573-0026-4506-adb7-4a25580d942d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:22.357178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-717e8573-0026-4506-adb7-4a25580d942d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:22.357937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-717e8573-0026-4506-adb7-4a25580d942d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:22.358370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-717e8573-0026-4506-adb7-4a25580d942d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:22.361235 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Going to run 1 instances... {{(pid=119155) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:39:22.363517 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119155) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:39:22.413699 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c1ce614a-14b4-42e4-ab9e-45a008c22208 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170362 Jul 28 03:39:22.414559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 183/344] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:39:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:39:22.419869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-94535cac-9b2f-4681-820d-993b51c18416 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:22.420693 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-94535cac-9b2f-4681-820d-993b51c18416 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:22.427099 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94535cac-9b2f-4681-820d-993b51c18416 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:22.427565 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94535cac-9b2f-4681-820d-993b51c18416 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:22.428403 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94535cac-9b2f-4681-820d-993b51c18416 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:22.428844 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94535cac-9b2f-4681-820d-993b51c18416 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:22.487261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-717e8573-0026-4506-adb7-4a25580d942d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:22.500662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-717e8573-0026-4506-adb7-4a25580d942d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.155091 Jul 28 03:39:22.502748 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 162/345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:22 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:22.507389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ab450246-2051-40ed-89ad-7869307b3ef8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:22.508035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ab450246-2051-40ed-89ad-7869307b3ef8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:22.587847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ab450246-2051-40ed-89ad-7869307b3ef8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:22.595083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ab450246-2051-40ed-89ad-7869307b3ef8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1214 microversion: 2.1 time: 0.090855 Jul 28 03:39:22.595644 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 163/346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:22 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:22.608008 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-94535cac-9b2f-4681-820d-993b51c18416 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:22.617309 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-94535cac-9b2f-4681-820d-993b51c18416 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.201614 Jul 28 03:39:22.617897 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 184/347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:22 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:23.361534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3f31c0f8-8656-4bee-9ce8-620f811c8d12 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:23.365000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3f31c0f8-8656-4bee-9ce8-620f811c8d12 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:23.372968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3f31c0f8-8656-4bee-9ce8-620f811c8d12 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:23.373460 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3f31c0f8-8656-4bee-9ce8-620f811c8d12 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:23.374386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3f31c0f8-8656-4bee-9ce8-620f811c8d12 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:23.374727 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3f31c0f8-8656-4bee-9ce8-620f811c8d12 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:23.498871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3f31c0f8-8656-4bee-9ce8-620f811c8d12 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:23.506496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3f31c0f8-8656-4bee-9ce8-620f811c8d12 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:23.508284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3f31c0f8-8656-4bee-9ce8-620f811c8d12 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:23.509422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3f31c0f8-8656-4bee-9ce8-620f811c8d12 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1720 microversion: 2.20 time: 0.151977 Jul 28 03:39:23.509973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 164/348] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:23 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:23.521647 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-177aae81-73ae-43fb-91cf-890b744fedb9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:23.522753 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-177aae81-73ae-43fb-91cf-890b744fedb9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:23.530947 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-177aae81-73ae-43fb-91cf-890b744fedb9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:23.531390 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-177aae81-73ae-43fb-91cf-890b744fedb9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:23.532198 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-177aae81-73ae-43fb-91cf-890b744fedb9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:23.532630 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-177aae81-73ae-43fb-91cf-890b744fedb9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:23.611837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-24556b48-c80b-4c2e-a6fb-71aff630b8d7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:23.612617 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-24556b48-c80b-4c2e-a6fb-71aff630b8d7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:23.618571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24556b48-c80b-4c2e-a6fb-71aff630b8d7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:23.619138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24556b48-c80b-4c2e-a6fb-71aff630b8d7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:23.620743 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24556b48-c80b-4c2e-a6fb-71aff630b8d7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:23.621580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24556b48-c80b-4c2e-a6fb-71aff630b8d7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:23.687290 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-177aae81-73ae-43fb-91cf-890b744fedb9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:23.693444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-24556b48-c80b-4c2e-a6fb-71aff630b8d7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:23.694606 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-177aae81-73ae-43fb-91cf-890b744fedb9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.179944 Jul 28 03:39:23.695336 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 185/349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:23 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:23.700261 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-74ba0c87-2782-4b08-a088-fff07c421c8f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:23.701217 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-74ba0c87-2782-4b08-a088-fff07c421c8f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:23.707273 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-74ba0c87-2782-4b08-a088-fff07c421c8f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:23.707998 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-74ba0c87-2782-4b08-a088-fff07c421c8f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:23.708994 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-74ba0c87-2782-4b08-a088-fff07c421c8f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:23.709586 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-74ba0c87-2782-4b08-a088-fff07c421c8f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:23.710956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-24556b48-c80b-4c2e-a6fb-71aff630b8d7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1210 microversion: 2.1 time: 0.102718 Jul 28 03:39:23.711735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 165/350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:23 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:23.847584 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-74ba0c87-2782-4b08-a088-fff07c421c8f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:23.855747 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-74ba0c87-2782-4b08-a088-fff07c421c8f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.158811 Jul 28 03:39:23.856314 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 186/351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:23 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:24.535715 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0abd8d2b-fcef-447a-b482-7952d30e22eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:24.536681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0abd8d2b-fcef-447a-b482-7952d30e22eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:24.543036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0abd8d2b-fcef-447a-b482-7952d30e22eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:24.543633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0abd8d2b-fcef-447a-b482-7952d30e22eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:24.544580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0abd8d2b-fcef-447a-b482-7952d30e22eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:24.545217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0abd8d2b-fcef-447a-b482-7952d30e22eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:24.677504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0abd8d2b-fcef-447a-b482-7952d30e22eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:24.686319 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0abd8d2b-fcef-447a-b482-7952d30e22eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:24.687834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0abd8d2b-fcef-447a-b482-7952d30e22eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:24.689006 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0abd8d2b-fcef-447a-b482-7952d30e22eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1741 microversion: 2.20 time: 0.157058 Jul 28 03:39:24.690019 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 166/352] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:24 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:24.711088 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-9a629e0e-5d61-4257-a48b-420e7f9aebfd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:24.711822 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-9a629e0e-5d61-4257-a48b-420e7f9aebfd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:24.717821 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9a629e0e-5d61-4257-a48b-420e7f9aebfd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:24.718361 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9a629e0e-5d61-4257-a48b-420e7f9aebfd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:24.719189 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9a629e0e-5d61-4257-a48b-420e7f9aebfd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:24.719689 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9a629e0e-5d61-4257-a48b-420e7f9aebfd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:24.728261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0f292f68-7a3b-4913-9646-4b4286b265ac tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:24.729105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0f292f68-7a3b-4913-9646-4b4286b265ac tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:24.742702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f292f68-7a3b-4913-9646-4b4286b265ac tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:24.743339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f292f68-7a3b-4913-9646-4b4286b265ac tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:24.744392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f292f68-7a3b-4913-9646-4b4286b265ac tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:24.745471 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f292f68-7a3b-4913-9646-4b4286b265ac tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:24.805930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0f292f68-7a3b-4913-9646-4b4286b265ac tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:24.814162 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0f292f68-7a3b-4913-9646-4b4286b265ac tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1272 microversion: 2.1 time: 0.089748 Jul 28 03:39:24.821045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 167/353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:24 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:24.874770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-00f3640c-bb18-4aec-8c34-15dd3d20a835 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:24.875305 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-00f3640c-bb18-4aec-8c34-15dd3d20a835 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:24.883349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-00f3640c-bb18-4aec-8c34-15dd3d20a835 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:24.883825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-00f3640c-bb18-4aec-8c34-15dd3d20a835 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:24.884605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-00f3640c-bb18-4aec-8c34-15dd3d20a835 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:24.885032 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-00f3640c-bb18-4aec-8c34-15dd3d20a835 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:24.921294 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-9a629e0e-5d61-4257-a48b-420e7f9aebfd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:24.930468 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-9a629e0e-5d61-4257-a48b-420e7f9aebfd tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.222922 Jul 28 03:39:24.931037 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 187/354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:24 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:25.011869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-00f3640c-bb18-4aec-8c34-15dd3d20a835 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:25.020725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-00f3640c-bb18-4aec-8c34-15dd3d20a835 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.150442 Jul 28 03:39:25.021452 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 168/355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:24 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:25.708131 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a157c067-c567-4431-aed1-e301a5d7c33e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:25.708956 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a157c067-c567-4431-aed1-e301a5d7c33e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:25.716708 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a157c067-c567-4431-aed1-e301a5d7c33e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:25.717792 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a157c067-c567-4431-aed1-e301a5d7c33e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:25.718755 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a157c067-c567-4431-aed1-e301a5d7c33e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:25.719349 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a157c067-c567-4431-aed1-e301a5d7c33e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:25.831497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4236b833-7684-41b5-af8b-0fc946044ae8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:25.832141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4236b833-7684-41b5-af8b-0fc946044ae8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:25.838480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4236b833-7684-41b5-af8b-0fc946044ae8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:25.839490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4236b833-7684-41b5-af8b-0fc946044ae8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:25.840481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4236b833-7684-41b5-af8b-0fc946044ae8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:25.840925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4236b833-7684-41b5-af8b-0fc946044ae8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:25.935500 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a157c067-c567-4431-aed1-e301a5d7c33e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:25.945031 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a157c067-c567-4431-aed1-e301a5d7c33e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:25.946507 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a157c067-c567-4431-aed1-e301a5d7c33e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:25.947658 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a157c067-c567-4431-aed1-e301a5d7c33e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1741 microversion: 2.20 time: 0.243224 Jul 28 03:39:25.949291 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 188/356] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:25 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:25.953901 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e184279b-a914-4c4d-9f9c-e5a7455b99db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:25.954507 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e184279b-a914-4c4d-9f9c-e5a7455b99db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:25.964846 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e184279b-a914-4c4d-9f9c-e5a7455b99db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:25.965403 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e184279b-a914-4c4d-9f9c-e5a7455b99db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:25.966405 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e184279b-a914-4c4d-9f9c-e5a7455b99db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:25.966908 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e184279b-a914-4c4d-9f9c-e5a7455b99db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:25.973086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4236b833-7684-41b5-af8b-0fc946044ae8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:25.981245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4236b833-7684-41b5-af8b-0fc946044ae8 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1314 microversion: 2.1 time: 0.153233 Jul 28 03:39:25.981895 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 169/357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:25 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:26.037886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-46e45e58-60dd-4dc2-b5f8-910505692e39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:26.038574 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-46e45e58-60dd-4dc2-b5f8-910505692e39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:26.044945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46e45e58-60dd-4dc2-b5f8-910505692e39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:26.045390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46e45e58-60dd-4dc2-b5f8-910505692e39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:26.046160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46e45e58-60dd-4dc2-b5f8-910505692e39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:26.046590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46e45e58-60dd-4dc2-b5f8-910505692e39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:26.184990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-46e45e58-60dd-4dc2-b5f8-910505692e39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:26.187210 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e184279b-a914-4c4d-9f9c-e5a7455b99db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:26.192921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-46e45e58-60dd-4dc2-b5f8-910505692e39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.158603 Jul 28 03:39:26.193499 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 170/358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:26 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:26.195415 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e184279b-a914-4c4d-9f9c-e5a7455b99db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.245046 Jul 28 03:39:26.195996 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 189/359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:25 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:26.197841 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-7db55f7d-42d7-42a5-a160-43ae6490dbe1 req-93678fec-9c7f-47c1-bebc-6d8667cb84ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40bb2c6a-5d90-460b-b078-9ac10259aa71", "tag": "8792223a-d071-4fa7-b0ff-10a8022e1419"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:26.200230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:26.200230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:39:26.207513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-7db55f7d-42d7-42a5-a160-43ae6490dbe1 req-93678fec-9c7f-47c1-bebc-6d8667cb84ad service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:26.207989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-7db55f7d-42d7-42a5-a160-43ae6490dbe1 req-93678fec-9c7f-47c1-bebc-6d8667cb84ad service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:26.219159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-7db55f7d-42d7-42a5-a160-43ae6490dbe1 req-93678fec-9c7f-47c1-bebc-6d8667cb84ad service nova] Creating event network-changed:8792223a-d071-4fa7-b0ff-10a8022e1419 for instance 40bb2c6a-5d90-460b-b078-9ac10259aa71 on hv-cinder-73306 Jul 28 03:39:26.224216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-7db55f7d-42d7-42a5-a160-43ae6490dbe1 req-93678fec-9c7f-47c1-bebc-6d8667cb84ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029587 Jul 28 03:39:26.224924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 171/360] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:26.966307 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5ad253d4-4ecb-4550-bfaf-3af1353a15a0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:26.966852 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5ad253d4-4ecb-4550-bfaf-3af1353a15a0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:26.974044 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5ad253d4-4ecb-4550-bfaf-3af1353a15a0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:26.974499 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5ad253d4-4ecb-4550-bfaf-3af1353a15a0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:26.975281 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5ad253d4-4ecb-4550-bfaf-3af1353a15a0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:26.976069 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5ad253d4-4ecb-4550-bfaf-3af1353a15a0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:26.998743 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-59241286-313d-4e98-827d-1cf192737eef tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:27.000316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-59241286-313d-4e98-827d-1cf192737eef tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:27.010112 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59241286-313d-4e98-827d-1cf192737eef tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:27.011654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59241286-313d-4e98-827d-1cf192737eef tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:27.012876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59241286-313d-4e98-827d-1cf192737eef tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:27.013325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59241286-313d-4e98-827d-1cf192737eef tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:27.155759 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-59241286-313d-4e98-827d-1cf192737eef tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.186702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-59241286-313d-4e98-827d-1cf192737eef tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1314 microversion: 2.1 time: 0.192825 Jul 28 03:39:27.195811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 172/361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:26 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:27.212710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d5b43ba6-b48a-4ac1-b479-c51039b3e9f7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:27.213335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d5b43ba6-b48a-4ac1-b479-c51039b3e9f7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:27.225179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5b43ba6-b48a-4ac1-b479-c51039b3e9f7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:27.225633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5b43ba6-b48a-4ac1-b479-c51039b3e9f7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:27.226402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5b43ba6-b48a-4ac1-b479-c51039b3e9f7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:27.227106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5b43ba6-b48a-4ac1-b479-c51039b3e9f7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:27.279493 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5ad253d4-4ecb-4550-bfaf-3af1353a15a0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.288437 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5ad253d4-4ecb-4550-bfaf-3af1353a15a0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.289959 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5ad253d4-4ecb-4550-bfaf-3af1353a15a0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.291121 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5ad253d4-4ecb-4550-bfaf-3af1353a15a0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1736 microversion: 2.20 time: 0.328687 Jul 28 03:39:27.291679 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 190/362] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:26 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1736 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:27.318407 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-29975f72-e0ae-4a9c-80bd-b2bd0e89b74d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:27.320003 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-29975f72-e0ae-4a9c-80bd-b2bd0e89b74d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:27.331826 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-29975f72-e0ae-4a9c-80bd-b2bd0e89b74d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:27.334174 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-29975f72-e0ae-4a9c-80bd-b2bd0e89b74d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:27.335151 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-29975f72-e0ae-4a9c-80bd-b2bd0e89b74d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:27.335583 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-29975f72-e0ae-4a9c-80bd-b2bd0e89b74d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:27.378608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d5b43ba6-b48a-4ac1-b479-c51039b3e9f7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.389385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d5b43ba6-b48a-4ac1-b479-c51039b3e9f7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.180636 Jul 28 03:39:27.390624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 173/363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:27 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:27.396231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-9d28be9c-940a-4909-b93e-74403da7d142 req-736bbc90-5eb8-4ac0-b481-e83f3d34a839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622af242-a6fc-4f2d-9f03-61e88ee5e89f", "name": "network-vif-plugged", "status": "completed", "tag": "f743ec9f-b513-4bb3-b819-5c932959e75f"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:27.414505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:27.414505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:39:27.425891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-9d28be9c-940a-4909-b93e-74403da7d142 req-736bbc90-5eb8-4ac0-b481-e83f3d34a839 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:27.426527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-9d28be9c-940a-4909-b93e-74403da7d142 req-736bbc90-5eb8-4ac0-b481-e83f3d34a839 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:27.445242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-9d28be9c-940a-4909-b93e-74403da7d142 req-736bbc90-5eb8-4ac0-b481-e83f3d34a839 service nova] Creating event network-vif-plugged:f743ec9f-b513-4bb3-b819-5c932959e75f for instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f on hv-cinder-73306 Jul 28 03:39:27.450423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-9d28be9c-940a-4909-b93e-74403da7d142 req-736bbc90-5eb8-4ac0-b481-e83f3d34a839 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057914 Jul 28 03:39:27.451465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 174/364] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:27.505027 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-29975f72-e0ae-4a9c-80bd-b2bd0e89b74d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.513371 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-29975f72-e0ae-4a9c-80bd-b2bd0e89b74d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.216965 Jul 28 03:39:27.513946 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 191/365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:27 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:28.203515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-64eddfac-6a3f-4d4a-a9ff-95b0bff1301f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:28.204972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-64eddfac-6a3f-4d4a-a9ff-95b0bff1301f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:28.211775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-64eddfac-6a3f-4d4a-a9ff-95b0bff1301f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:28.212428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-64eddfac-6a3f-4d4a-a9ff-95b0bff1301f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:28.213351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-64eddfac-6a3f-4d4a-a9ff-95b0bff1301f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:28.214552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-64eddfac-6a3f-4d4a-a9ff-95b0bff1301f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:28.310491 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1a35d2af-bb89-41a8-a2a6-9fe6838415b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:28.311166 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1a35d2af-bb89-41a8-a2a6-9fe6838415b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:28.334110 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1a35d2af-bb89-41a8-a2a6-9fe6838415b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:28.334394 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1a35d2af-bb89-41a8-a2a6-9fe6838415b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:28.341686 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1a35d2af-bb89-41a8-a2a6-9fe6838415b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:28.342388 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1a35d2af-bb89-41a8-a2a6-9fe6838415b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:28.380352 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-64eddfac-6a3f-4d4a-a9ff-95b0bff1301f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:28.392041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-64eddfac-6a3f-4d4a-a9ff-95b0bff1301f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1314 microversion: 2.1 time: 0.192437 Jul 28 03:39:28.393294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 175/366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:28 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:28.413539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-92b10a3a-a528-4e1c-a689-272f08774f7b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:28.414427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-92b10a3a-a528-4e1c-a689-272f08774f7b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:28.430138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92b10a3a-a528-4e1c-a689-272f08774f7b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:28.434669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92b10a3a-a528-4e1c-a689-272f08774f7b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:28.435606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92b10a3a-a528-4e1c-a689-272f08774f7b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:28.437773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92b10a3a-a528-4e1c-a689-272f08774f7b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:28.509530 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1a35d2af-bb89-41a8-a2a6-9fe6838415b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:28.518336 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1a35d2af-bb89-41a8-a2a6-9fe6838415b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:28.520764 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1a35d2af-bb89-41a8-a2a6-9fe6838415b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:28.522127 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1a35d2af-bb89-41a8-a2a6-9fe6838415b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1736 microversion: 2.20 time: 0.215770 Jul 28 03:39:28.533047 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 192/367] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:28 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:28.543754 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a837e031-ff2e-4f2e-9d1e-613065a7fa34 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:28.544650 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a837e031-ff2e-4f2e-9d1e-613065a7fa34 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:28.552799 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a837e031-ff2e-4f2e-9d1e-613065a7fa34 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:28.553245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a837e031-ff2e-4f2e-9d1e-613065a7fa34 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:28.554015 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a837e031-ff2e-4f2e-9d1e-613065a7fa34 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:28.554443 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a837e031-ff2e-4f2e-9d1e-613065a7fa34 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:28.632222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-92b10a3a-a528-4e1c-a689-272f08774f7b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:28.642426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-92b10a3a-a528-4e1c-a689-272f08774f7b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.237070 Jul 28 03:39:28.645829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 176/368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:28 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:28.725187 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a837e031-ff2e-4f2e-9d1e-613065a7fa34 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:28.734782 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a837e031-ff2e-4f2e-9d1e-613065a7fa34 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.206322 Jul 28 03:39:28.735335 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 193/369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:28 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:29.412768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f61bcf01-c22f-426f-be21-d560a881b65f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:29.414679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f61bcf01-c22f-426f-be21-d560a881b65f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:29.424007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f61bcf01-c22f-426f-be21-d560a881b65f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:29.425364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f61bcf01-c22f-426f-be21-d560a881b65f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:29.426773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f61bcf01-c22f-426f-be21-d560a881b65f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:29.427390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f61bcf01-c22f-426f-be21-d560a881b65f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:29.542394 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-dec3fd37-8943-4f10-b36e-db24e2b80abf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:29.543801 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-dec3fd37-8943-4f10-b36e-db24e2b80abf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:29.563620 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dec3fd37-8943-4f10-b36e-db24e2b80abf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:29.564423 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dec3fd37-8943-4f10-b36e-db24e2b80abf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:29.565968 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dec3fd37-8943-4f10-b36e-db24e2b80abf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:29.566887 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dec3fd37-8943-4f10-b36e-db24e2b80abf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:29.638832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f61bcf01-c22f-426f-be21-d560a881b65f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:29.649922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f61bcf01-c22f-426f-be21-d560a881b65f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1314 microversion: 2.1 time: 0.244076 Jul 28 03:39:29.660756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 177/370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:29 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:29.673495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c1b4a87f-44ac-4c7d-8700-df4dd3a1924e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:29.676448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c1b4a87f-44ac-4c7d-8700-df4dd3a1924e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:29.693898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1b4a87f-44ac-4c7d-8700-df4dd3a1924e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:29.694448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1b4a87f-44ac-4c7d-8700-df4dd3a1924e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:29.696826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1b4a87f-44ac-4c7d-8700-df4dd3a1924e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:29.697309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1b4a87f-44ac-4c7d-8700-df4dd3a1924e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:29.826896 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-dec3fd37-8943-4f10-b36e-db24e2b80abf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:29.835481 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-dec3fd37-8943-4f10-b36e-db24e2b80abf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:29.839934 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-dec3fd37-8943-4f10-b36e-db24e2b80abf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:29.844214 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-dec3fd37-8943-4f10-b36e-db24e2b80abf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1736 microversion: 2.20 time: 0.307508 Jul 28 03:39:29.846788 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 194/371] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:29 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1736 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:29.851563 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-4a6d2fb9-b458-4d8b-884b-86006cd2f66a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:29.853246 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-4a6d2fb9-b458-4d8b-884b-86006cd2f66a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:29.865333 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4a6d2fb9-b458-4d8b-884b-86006cd2f66a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:29.866124 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4a6d2fb9-b458-4d8b-884b-86006cd2f66a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:29.869593 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4a6d2fb9-b458-4d8b-884b-86006cd2f66a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:29.870333 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4a6d2fb9-b458-4d8b-884b-86006cd2f66a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:29.888825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c1b4a87f-44ac-4c7d-8700-df4dd3a1924e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:29.907422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c1b4a87f-44ac-4c7d-8700-df4dd3a1924e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.242335 Jul 28 03:39:29.908153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 178/372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:29 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:30.040349 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-4a6d2fb9-b458-4d8b-884b-86006cd2f66a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:30.049076 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-4a6d2fb9-b458-4d8b-884b-86006cd2f66a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.201168 Jul 28 03:39:30.050212 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 195/373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:29 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:30.668378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ca39013a-b110-4ac3-b4ca-37f56b6282b7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:30.669701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ca39013a-b110-4ac3-b4ca-37f56b6282b7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:30.680101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca39013a-b110-4ac3-b4ca-37f56b6282b7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:30.685377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca39013a-b110-4ac3-b4ca-37f56b6282b7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:30.686367 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca39013a-b110-4ac3-b4ca-37f56b6282b7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:30.686905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca39013a-b110-4ac3-b4ca-37f56b6282b7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:30.873416 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-35f0a2c8-986f-42c5-8866-9c902e0e382c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:30.874788 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-35f0a2c8-986f-42c5-8866-9c902e0e382c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:30.888706 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-35f0a2c8-986f-42c5-8866-9c902e0e382c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:30.890564 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-35f0a2c8-986f-42c5-8866-9c902e0e382c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:30.891954 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-35f0a2c8-986f-42c5-8866-9c902e0e382c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:30.892400 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-35f0a2c8-986f-42c5-8866-9c902e0e382c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:30.916869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ca39013a-b110-4ac3-b4ca-37f56b6282b7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:30.928214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ca39013a-b110-4ac3-b4ca-37f56b6282b7 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1314 microversion: 2.1 time: 0.264023 Jul 28 03:39:30.929364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 179/374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:30 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:30.941158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dfe68626-27d3-40ae-996d-23e2d2122e5e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:30.951948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dfe68626-27d3-40ae-996d-23e2d2122e5e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:30.959332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfe68626-27d3-40ae-996d-23e2d2122e5e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:30.961545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfe68626-27d3-40ae-996d-23e2d2122e5e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:30.962381 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfe68626-27d3-40ae-996d-23e2d2122e5e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:30.962846 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfe68626-27d3-40ae-996d-23e2d2122e5e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:31.105840 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-35f0a2c8-986f-42c5-8866-9c902e0e382c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:31.122590 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-35f0a2c8-986f-42c5-8866-9c902e0e382c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:31.129981 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-35f0a2c8-986f-42c5-8866-9c902e0e382c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:31.131181 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-35f0a2c8-986f-42c5-8866-9c902e0e382c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1736 microversion: 2.20 time: 0.264889 Jul 28 03:39:31.131738 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 196/375] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:30 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1736 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:31.141823 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-09de495b-b186-4bbd-afc4-672f28aa9b0e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:31.142306 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-09de495b-b186-4bbd-afc4-672f28aa9b0e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:31.156358 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-09de495b-b186-4bbd-afc4-672f28aa9b0e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:31.156811 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-09de495b-b186-4bbd-afc4-672f28aa9b0e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:31.157597 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-09de495b-b186-4bbd-afc4-672f28aa9b0e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:31.158031 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-09de495b-b186-4bbd-afc4-672f28aa9b0e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:31.254788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dfe68626-27d3-40ae-996d-23e2d2122e5e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:31.266272 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dfe68626-27d3-40ae-996d-23e2d2122e5e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.335289 Jul 28 03:39:31.270325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 180/376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:30 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:31.279054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eb199f29-869e-4599-a5c7-2a14a0f68b4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:31.279674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eb199f29-869e-4599-a5c7-2a14a0f68b4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:31.285982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb199f29-869e-4599-a5c7-2a14a0f68b4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:31.286437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb199f29-869e-4599-a5c7-2a14a0f68b4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:31.287294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb199f29-869e-4599-a5c7-2a14a0f68b4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:31.287759 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb199f29-869e-4599-a5c7-2a14a0f68b4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:31.358166 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.objects.instance [None req-09de495b-b186-4bbd-afc4-672f28aa9b0e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lazy-loading 'services' on Instance uuid a13f1d98-e65b-42e1-b39c-b225093adc02 {{(pid=119155) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:39:31.472137 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eb199f29-869e-4599-a5c7-2a14a0f68b4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:31.483336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eb199f29-869e-4599-a5c7-2a14a0f68b4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.211782 Jul 28 03:39:31.484552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 181/377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:31 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:31.530835 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-09de495b-b186-4bbd-afc4-672f28aa9b0e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02/os-volume_attachments/f5b5be43-f404-4886-ae1e-bbba27ad74fa" status: 202 len: 0 microversion: 2.1 time: 0.397760 Jul 28 03:39:31.531763 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 197/378] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Jul 28 03:39:31 2021] DELETE /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02/os-volume_attachments/f5b5be43-f404-4886-ae1e-bbba27ad74fa => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:39:31.947096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4581464d-b43a-45dc-b2fe-f2e9668ce706 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:31.947859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4581464d-b43a-45dc-b2fe-f2e9668ce706 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:31.954818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4581464d-b43a-45dc-b2fe-f2e9668ce706 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:31.955199 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4581464d-b43a-45dc-b2fe-f2e9668ce706 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:31.955993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4581464d-b43a-45dc-b2fe-f2e9668ce706 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:31.956638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4581464d-b43a-45dc-b2fe-f2e9668ce706 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:32.117569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4581464d-b43a-45dc-b2fe-f2e9668ce706 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:32.131876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4581464d-b43a-45dc-b2fe-f2e9668ce706 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1314 microversion: 2.1 time: 0.186631 Jul 28 03:39:32.133222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 182/379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:31 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:32.152825 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fdf62638-0992-4a67-8588-420167f5a43c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:32.153571 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-fdf62638-0992-4a67-8588-420167f5a43c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:32.161286 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fdf62638-0992-4a67-8588-420167f5a43c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:32.161957 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fdf62638-0992-4a67-8588-420167f5a43c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:32.169353 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fdf62638-0992-4a67-8588-420167f5a43c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:32.170247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fdf62638-0992-4a67-8588-420167f5a43c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:32.282094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1da574b9-2678-476e-987e-f163e0f03ec6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:32.282850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1da574b9-2678-476e-987e-f163e0f03ec6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:32.290144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1da574b9-2678-476e-987e-f163e0f03ec6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:32.291311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1da574b9-2678-476e-987e-f163e0f03ec6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:32.294425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1da574b9-2678-476e-987e-f163e0f03ec6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:32.295007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1da574b9-2678-476e-987e-f163e0f03ec6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:32.361677 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-fdf62638-0992-4a67-8588-420167f5a43c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:32.375234 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-fdf62638-0992-4a67-8588-420167f5a43c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:32.378768 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-fdf62638-0992-4a67-8588-420167f5a43c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:32.380961 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-fdf62638-0992-4a67-8588-420167f5a43c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1736 microversion: 2.20 time: 0.234688 Jul 28 03:39:32.399292 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 198/380] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:32 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:32.502505 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1c4c8335-bd32-4407-a0e2-6842e190026b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:32.503025 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1c4c8335-bd32-4407-a0e2-6842e190026b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:32.512084 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1c4c8335-bd32-4407-a0e2-6842e190026b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:32.512538 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1c4c8335-bd32-4407-a0e2-6842e190026b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:32.513814 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1c4c8335-bd32-4407-a0e2-6842e190026b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:32.516200 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1c4c8335-bd32-4407-a0e2-6842e190026b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:32.537720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1da574b9-2678-476e-987e-f163e0f03ec6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:32.549248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1da574b9-2678-476e-987e-f163e0f03ec6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.269038 Jul 28 03:39:32.552185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 183/381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:32 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:32.704251 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1c4c8335-bd32-4407-a0e2-6842e190026b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:32.721842 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1c4c8335-bd32-4407-a0e2-6842e190026b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1723 microversion: 2.1 time: 0.223291 Jul 28 03:39:32.722985 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 199/382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:32 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:33.149742 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fb3c7520-c056-43e7-9209-c5c34b127a2b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:33.152251 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fb3c7520-c056-43e7-9209-c5c34b127a2b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:33.161010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb3c7520-c056-43e7-9209-c5c34b127a2b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:33.161865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb3c7520-c056-43e7-9209-c5c34b127a2b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:33.163511 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb3c7520-c056-43e7-9209-c5c34b127a2b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:33.164194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb3c7520-c056-43e7-9209-c5c34b127a2b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:33.399379 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5cc2be55-1ae3-4334-bbf0-3ffe0f4a816a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:33.400004 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5cc2be55-1ae3-4334-bbf0-3ffe0f4a816a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:33.410413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fb3c7520-c056-43e7-9209-c5c34b127a2b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:33.417121 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cc2be55-1ae3-4334-bbf0-3ffe0f4a816a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:33.417577 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cc2be55-1ae3-4334-bbf0-3ffe0f4a816a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:33.418363 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cc2be55-1ae3-4334-bbf0-3ffe0f4a816a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:33.418818 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cc2be55-1ae3-4334-bbf0-3ffe0f4a816a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:33.423942 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fb3c7520-c056-43e7-9209-c5c34b127a2b tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1314 microversion: 2.1 time: 0.277848 Jul 28 03:39:33.424775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 184/383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:33 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:33.569826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a32c50b8-bfe6-4089-b3e4-40cb4878d6fc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:33.570434 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a32c50b8-bfe6-4089-b3e4-40cb4878d6fc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:33.582266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a32c50b8-bfe6-4089-b3e4-40cb4878d6fc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:33.582974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a32c50b8-bfe6-4089-b3e4-40cb4878d6fc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:33.584305 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a32c50b8-bfe6-4089-b3e4-40cb4878d6fc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:33.585189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a32c50b8-bfe6-4089-b3e4-40cb4878d6fc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:33.638557 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5cc2be55-1ae3-4334-bbf0-3ffe0f4a816a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:33.647753 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5cc2be55-1ae3-4334-bbf0-3ffe0f4a816a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:33.654686 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5cc2be55-1ae3-4334-bbf0-3ffe0f4a816a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:33.656281 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5cc2be55-1ae3-4334-bbf0-3ffe0f4a816a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1736 microversion: 2.20 time: 0.260609 Jul 28 03:39:33.659335 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 200/384] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:33 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:33.680011 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-eb8cdf3f-b258-4342-9ad9-39a46ac4a553 req-8584ec9e-12b0-49d5-9c42-02acad7bc16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40bb2c6a-5d90-460b-b078-9ac10259aa71", "name": "network-vif-plugged", "status": "completed", "tag": "8792223a-d071-4fa7-b0ff-10a8022e1419"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:33.684231 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:33.684231 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:39:33.695697 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-eb8cdf3f-b258-4342-9ad9-39a46ac4a553 req-8584ec9e-12b0-49d5-9c42-02acad7bc16d service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:33.696704 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-eb8cdf3f-b258-4342-9ad9-39a46ac4a553 req-8584ec9e-12b0-49d5-9c42-02acad7bc16d service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:33.721723 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-eb8cdf3f-b258-4342-9ad9-39a46ac4a553 req-8584ec9e-12b0-49d5-9c42-02acad7bc16d service nova] Creating event network-vif-plugged:8792223a-d071-4fa7-b0ff-10a8022e1419 for instance 40bb2c6a-5d90-460b-b078-9ac10259aa71 on hv-cinder-73306 Jul 28 03:39:33.732024 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-eb8cdf3f-b258-4342-9ad9-39a46ac4a553 req-8584ec9e-12b0-49d5-9c42-02acad7bc16d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068365 Jul 28 03:39:33.733139 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 201/385] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:33.742005 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-4c842d5b-02cf-4748-8937-a9815ae8c3e0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:33.743347 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-4c842d5b-02cf-4748-8937-a9815ae8c3e0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:33.751319 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4c842d5b-02cf-4748-8937-a9815ae8c3e0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:33.752515 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4c842d5b-02cf-4748-8937-a9815ae8c3e0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:33.753816 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4c842d5b-02cf-4748-8937-a9815ae8c3e0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:33.754472 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4c842d5b-02cf-4748-8937-a9815ae8c3e0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:33.865561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a32c50b8-bfe6-4089-b3e4-40cb4878d6fc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:33.881554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a32c50b8-bfe6-4089-b3e4-40cb4878d6fc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.315573 Jul 28 03:39:33.892247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 185/386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:33 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:34.152663 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-4c842d5b-02cf-4748-8937-a9815ae8c3e0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:34.161203 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-4c842d5b-02cf-4748-8937-a9815ae8c3e0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1700 microversion: 2.1 time: 0.425008 Jul 28 03:39:34.162083 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 202/387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:33 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1700 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:34.178866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-33a36656-e410-437f-9af5-e37a389edfa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:34.185766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-33a36656-e410-437f-9af5-e37a389edfa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:34.186410 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-33a36656-e410-437f-9af5-e37a389edfa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:34.215498 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-33a36656-e410-437f-9af5-e37a389edfa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Going to try to start instance {{(pid=119154) start /opt/stack/nova/nova/compute/api.py:2603}} Jul 28 03:39:34.280920 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-33a36656-e410-437f-9af5-e37a389edfa4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action" status: 202 len: 0 microversion: 2.1 time: 0.104012 Jul 28 03:39:34.282205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 186/388] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:39:34 2021] POST /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:39:34.289824 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d2b0c3f7-e748-46c6-8f66-ba8a8b13c27f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:34.290598 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d2b0c3f7-e748-46c6-8f66-ba8a8b13c27f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:34.296814 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d2b0c3f7-e748-46c6-8f66-ba8a8b13c27f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:34.297344 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d2b0c3f7-e748-46c6-8f66-ba8a8b13c27f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:34.298118 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d2b0c3f7-e748-46c6-8f66-ba8a8b13c27f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:34.298552 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d2b0c3f7-e748-46c6-8f66-ba8a8b13c27f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:34.443969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c3625270-13f0-4a8a-91d7-6ae3715a8f59 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:34.444678 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c3625270-13f0-4a8a-91d7-6ae3715a8f59 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:34.458198 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3625270-13f0-4a8a-91d7-6ae3715a8f59 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:34.458923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3625270-13f0-4a8a-91d7-6ae3715a8f59 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:34.459741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3625270-13f0-4a8a-91d7-6ae3715a8f59 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:34.460348 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3625270-13f0-4a8a-91d7-6ae3715a8f59 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:34.516031 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d2b0c3f7-e748-46c6-8f66-ba8a8b13c27f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:34.530443 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d2b0c3f7-e748-46c6-8f66-ba8a8b13c27f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1709 microversion: 2.1 time: 0.244257 Jul 28 03:39:34.539097 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 203/389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:34 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1709 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:34.678893 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-910e2802-8cc4-496d-8add-3b17446ee7f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:34.679497 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-910e2802-8cc4-496d-8add-3b17446ee7f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:34.690171 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c3625270-13f0-4a8a-91d7-6ae3715a8f59 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:34.693027 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-910e2802-8cc4-496d-8add-3b17446ee7f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:34.693716 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-910e2802-8cc4-496d-8add-3b17446ee7f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:34.694889 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-910e2802-8cc4-496d-8add-3b17446ee7f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:34.696324 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-910e2802-8cc4-496d-8add-3b17446ee7f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:34.703001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c3625270-13f0-4a8a-91d7-6ae3715a8f59 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1314 microversion: 2.1 time: 0.259999 Jul 28 03:39:34.703746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 187/390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:34 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:34.892454 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-910e2802-8cc4-496d-8add-3b17446ee7f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:34.898199 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-708101c0-c7d2-4e9f-bde9-9f856444e955 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:34.898815 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-708101c0-c7d2-4e9f-bde9-9f856444e955 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:34.903663 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-910e2802-8cc4-496d-8add-3b17446ee7f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:34.905661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-708101c0-c7d2-4e9f-bde9-9f856444e955 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:34.905793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-708101c0-c7d2-4e9f-bde9-9f856444e955 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:34.906564 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-708101c0-c7d2-4e9f-bde9-9f856444e955 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:34.907008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-708101c0-c7d2-4e9f-bde9-9f856444e955 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:34.907382 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-910e2802-8cc4-496d-8add-3b17446ee7f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:34.908658 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-910e2802-8cc4-496d-8add-3b17446ee7f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1736 microversion: 2.20 time: 0.235451 Jul 28 03:39:34.911267 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 204/391] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:34 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:35.048937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-708101c0-c7d2-4e9f-bde9-9f856444e955 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:35.057297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-708101c0-c7d2-4e9f-bde9-9f856444e955 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.162668 Jul 28 03:39:35.058062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 188/392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:34 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:35.221196 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fd635f68-6bc0-4c90-9c7b-e175096bec0a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:35.221796 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-fd635f68-6bc0-4c90-9c7b-e175096bec0a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:35.234373 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fd635f68-6bc0-4c90-9c7b-e175096bec0a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:35.234911 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fd635f68-6bc0-4c90-9c7b-e175096bec0a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:35.235689 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fd635f68-6bc0-4c90-9c7b-e175096bec0a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:35.236140 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fd635f68-6bc0-4c90-9c7b-e175096bec0a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:35.268955 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-fd635f68-6bc0-4c90-9c7b-e175096bec0a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Going to try to terminate instance {{(pid=119155) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:39:35.394441 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-fd635f68-6bc0-4c90-9c7b-e175096bec0a tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 204 len: 0 microversion: 2.1 time: 0.176577 Jul 28 03:39:35.400646 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 205/393] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:39:35 2021] DELETE /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:39:35.405585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-414d3cb0-2608-4bf9-ba60-8acc0b6a8528 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:35.406198 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-414d3cb0-2608-4bf9-ba60-8acc0b6a8528 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:35.412803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-414d3cb0-2608-4bf9-ba60-8acc0b6a8528 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:35.413250 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-414d3cb0-2608-4bf9-ba60-8acc0b6a8528 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:35.414025 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-414d3cb0-2608-4bf9-ba60-8acc0b6a8528 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:35.414523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-414d3cb0-2608-4bf9-ba60-8acc0b6a8528 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:35.550789 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2cce5a30-c2cb-4ed9-8bac-d1d74f1c8067 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:35.551383 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2cce5a30-c2cb-4ed9-8bac-d1d74f1c8067 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:35.562519 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2cce5a30-c2cb-4ed9-8bac-d1d74f1c8067 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:35.563241 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2cce5a30-c2cb-4ed9-8bac-d1d74f1c8067 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:35.566863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-414d3cb0-2608-4bf9-ba60-8acc0b6a8528 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:35.574985 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2cce5a30-c2cb-4ed9-8bac-d1d74f1c8067 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:35.575755 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-414d3cb0-2608-4bf9-ba60-8acc0b6a8528 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1511 microversion: 2.1 time: 0.174530 Jul 28 03:39:35.576403 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2cce5a30-c2cb-4ed9-8bac-d1d74f1c8067 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:35.577246 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 189/394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:35 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:35.721995 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-18419670-d735-43e3-b923-e521200cc9ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:35.736802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-18419670-d735-43e3-b923-e521200cc9ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:35.742826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18419670-d735-43e3-b923-e521200cc9ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:35.743588 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18419670-d735-43e3-b923-e521200cc9ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:35.746201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18419670-d735-43e3-b923-e521200cc9ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:35.746927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18419670-d735-43e3-b923-e521200cc9ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:35.758868 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-2cce5a30-c2cb-4ed9-8bac-d1d74f1c8067 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:35.772432 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2cce5a30-c2cb-4ed9-8bac-d1d74f1c8067 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1709 microversion: 2.1 time: 0.224470 Jul 28 03:39:35.773901 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 206/395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:35 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1709 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:35.827559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1175524109", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "networks": [{"uuid": "8c357690-498e-4e5c-bdce-1e52bd2b1279"}]}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:35.909290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-18419670-d735-43e3-b923-e521200cc9ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:35.927289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-18419670-d735-43e3-b923-e521200cc9ec tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1314 microversion: 2.1 time: 0.210500 Jul 28 03:39:35.930596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 190/396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:35 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:35.942569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ec53df6e-fadb-49e2-8465-33c0175ebd44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:35.943360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ec53df6e-fadb-49e2-8465-33c0175ebd44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:35.950231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec53df6e-fadb-49e2-8465-33c0175ebd44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:35.950674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec53df6e-fadb-49e2-8465-33c0175ebd44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:35.951508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec53df6e-fadb-49e2-8465-33c0175ebd44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:35.952021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec53df6e-fadb-49e2-8465-33c0175ebd44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:36.099121 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ec53df6e-fadb-49e2-8465-33c0175ebd44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:36.108979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ec53df6e-fadb-49e2-8465-33c0175ebd44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:36.110727 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ec53df6e-fadb-49e2-8465-33c0175ebd44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:36.112056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ec53df6e-fadb-49e2-8465-33c0175ebd44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1736 microversion: 2.20 time: 0.180421 Jul 28 03:39:36.112805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 191/397] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:35 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:36.117235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9158fb83-7c7f-4d0b-a5a4-0e73b266b2cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:36.117878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9158fb83-7c7f-4d0b-a5a4-0e73b266b2cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:36.130454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9158fb83-7c7f-4d0b-a5a4-0e73b266b2cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:36.130842 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9158fb83-7c7f-4d0b-a5a4-0e73b266b2cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:36.131625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9158fb83-7c7f-4d0b-a5a4-0e73b266b2cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:36.132078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9158fb83-7c7f-4d0b-a5a4-0e73b266b2cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:36.263746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9158fb83-7c7f-4d0b-a5a4-0e73b266b2cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:36.271539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9158fb83-7c7f-4d0b-a5a4-0e73b266b2cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.157759 Jul 28 03:39:36.272333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 192/398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:36 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:36.598448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fa4c0e8e-7d8d-458f-8666-8f1f4b70e872 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:36.600015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fa4c0e8e-7d8d-458f-8666-8f1f4b70e872 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:36.607613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa4c0e8e-7d8d-458f-8666-8f1f4b70e872 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:36.608249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa4c0e8e-7d8d-458f-8666-8f1f4b70e872 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:36.609092 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa4c0e8e-7d8d-458f-8666-8f1f4b70e872 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:36.609888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa4c0e8e-7d8d-458f-8666-8f1f4b70e872 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:36.746081 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fa4c0e8e-7d8d-458f-8666-8f1f4b70e872 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:36.753812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fa4c0e8e-7d8d-458f-8666-8f1f4b70e872 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1511 microversion: 2.1 time: 0.159313 Jul 28 03:39:36.754377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 193/399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:36 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:36.789922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a367ab1b-9095-4118-b6e4-941cd29d8f0f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:36.790794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a367ab1b-9095-4118-b6e4-941cd29d8f0f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:36.799840 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a367ab1b-9095-4118-b6e4-941cd29d8f0f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:36.800282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a367ab1b-9095-4118-b6e4-941cd29d8f0f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:36.801232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a367ab1b-9095-4118-b6e4-941cd29d8f0f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:36.801663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a367ab1b-9095-4118-b6e4-941cd29d8f0f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:36.989191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a367ab1b-9095-4118-b6e4-941cd29d8f0f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:36.999107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a367ab1b-9095-4118-b6e4-941cd29d8f0f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1709 microversion: 2.1 time: 0.212767 Jul 28 03:39:36.999733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 194/400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:36 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1709 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:37.004134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-053ccd9e-9f23-4e70-8333-1a44e08430aa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:37.004746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-053ccd9e-9f23-4e70-8333-1a44e08430aa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:37.011134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-053ccd9e-9f23-4e70-8333-1a44e08430aa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:37.011796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-053ccd9e-9f23-4e70-8333-1a44e08430aa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:37.012663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-053ccd9e-9f23-4e70-8333-1a44e08430aa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:37.014462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-053ccd9e-9f23-4e70-8333-1a44e08430aa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:37.159655 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-053ccd9e-9f23-4e70-8333-1a44e08430aa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:37.167697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-053ccd9e-9f23-4e70-8333-1a44e08430aa tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1498 microversion: 2.1 time: 0.166878 Jul 28 03:39:37.168645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 195/401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:36 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:37.173220 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e8351cb2-d904-40a0-90d8-3b6350e1db6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:37.181700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e8351cb2-d904-40a0-90d8-3b6350e1db6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:37.200188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8351cb2-d904-40a0-90d8-3b6350e1db6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:37.200650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8351cb2-d904-40a0-90d8-3b6350e1db6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:37.201459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8351cb2-d904-40a0-90d8-3b6350e1db6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:37.210754 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8351cb2-d904-40a0-90d8-3b6350e1db6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:37.368938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e8351cb2-d904-40a0-90d8-3b6350e1db6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:37.384605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e8351cb2-d904-40a0-90d8-3b6350e1db6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:37.387433 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e8351cb2-d904-40a0-90d8-3b6350e1db6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:37.390220 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e8351cb2-d904-40a0-90d8-3b6350e1db6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1736 microversion: 2.20 time: 0.219129 Jul 28 03:39:37.390908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 196/402] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:37 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:37.399508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b868edd0-42f9-4b52-8515-6045b5cb28ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:37.416584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b868edd0-42f9-4b52-8515-6045b5cb28ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:37.416584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b868edd0-42f9-4b52-8515-6045b5cb28ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:37.416584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b868edd0-42f9-4b52-8515-6045b5cb28ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:37.416584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b868edd0-42f9-4b52-8515-6045b5cb28ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:37.417109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b868edd0-42f9-4b52-8515-6045b5cb28ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:37.568893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b868edd0-42f9-4b52-8515-6045b5cb28ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:37.582302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b868edd0-42f9-4b52-8515-6045b5cb28ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.188108 Jul 28 03:39:37.592072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 197/403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:37 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:37.774085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0d1596a6-7616-419b-988a-16833e2026f1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:37.775063 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0d1596a6-7616-419b-988a-16833e2026f1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:37.781694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d1596a6-7616-419b-988a-16833e2026f1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:37.782260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d1596a6-7616-419b-988a-16833e2026f1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:37.783134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d1596a6-7616-419b-988a-16833e2026f1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:37.783660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d1596a6-7616-419b-988a-16833e2026f1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:37.923486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0d1596a6-7616-419b-988a-16833e2026f1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:37.931557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0d1596a6-7616-419b-988a-16833e2026f1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1511 microversion: 2.1 time: 0.161202 Jul 28 03:39:37.932587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 198/404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:37 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:38.018305 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5989c326-00db-43cb-b238-eef3dbcf7e54 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:38.019095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5989c326-00db-43cb-b238-eef3dbcf7e54 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:38.030906 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5989c326-00db-43cb-b238-eef3dbcf7e54 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.031480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5989c326-00db-43cb-b238-eef3dbcf7e54 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.032486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5989c326-00db-43cb-b238-eef3dbcf7e54 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.033169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5989c326-00db-43cb-b238-eef3dbcf7e54 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.180328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5989c326-00db-43cb-b238-eef3dbcf7e54 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:38.187926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5989c326-00db-43cb-b238-eef3dbcf7e54 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1713 microversion: 2.1 time: 0.174449 Jul 28 03:39:38.188375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 199/405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:38 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1713 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:38.202517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0817f259-7008-48b9-88ce-febae4114537 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:38.203008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0817f259-7008-48b9-88ce-febae4114537 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:38.209387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0817f259-7008-48b9-88ce-febae4114537 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.209836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0817f259-7008-48b9-88ce-febae4114537 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.210603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0817f259-7008-48b9-88ce-febae4114537 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.211034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0817f259-7008-48b9-88ce-febae4114537 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.237829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0817f259-7008-48b9-88ce-febae4114537 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:39:38.318140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0817f259-7008-48b9-88ce-febae4114537 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 204 len: 0 microversion: 2.1 time: 0.119828 Jul 28 03:39:38.319791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 200/406] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:39:38 2021] DELETE /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:39:38.328802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9e3f28aa-774f-46f9-a43c-045a9ae2937e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:38.329516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9e3f28aa-774f-46f9-a43c-045a9ae2937e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:38.335531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e3f28aa-774f-46f9-a43c-045a9ae2937e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.336046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e3f28aa-774f-46f9-a43c-045a9ae2937e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.336819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e3f28aa-774f-46f9-a43c-045a9ae2937e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.337250 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e3f28aa-774f-46f9-a43c-045a9ae2937e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.356063 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.network.neutron [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] validate_networks() for [('8c357690-498e-4e5c-bdce-1e52bd2b1279', None, None, None)] {{(pid=119155) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:39:38.467826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9e3f28aa-774f-46f9-a43c-045a9ae2937e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:38.475289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9e3f28aa-774f-46f9-a43c-045a9ae2937e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1504 microversion: 2.1 time: 0.150908 Jul 28 03:39:38.475877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 201/407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:38 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:38.481109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-df75ad6b-45d3-45e0-9076-94da9baf785c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:38.481363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-df75ad6b-45d3-45e0-9076-94da9baf785c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:38.487050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df75ad6b-45d3-45e0-9076-94da9baf785c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.487494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df75ad6b-45d3-45e0-9076-94da9baf785c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.488283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df75ad6b-45d3-45e0-9076-94da9baf785c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.488714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df75ad6b-45d3-45e0-9076-94da9baf785c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.625452 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-df75ad6b-45d3-45e0-9076-94da9baf785c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:38.634085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-df75ad6b-45d3-45e0-9076-94da9baf785c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:38.635831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-df75ad6b-45d3-45e0-9076-94da9baf785c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:38.636953 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-df75ad6b-45d3-45e0-9076-94da9baf785c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1736 microversion: 2.20 time: 0.160157 Jul 28 03:39:38.637503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 202/408] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:38 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:38.641866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-381a6fb0-a36c-4938-8069-59c6d9127199 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:38.642465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-381a6fb0-a36c-4938-8069-59c6d9127199 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:38.648787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-381a6fb0-a36c-4938-8069-59c6d9127199 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.649235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-381a6fb0-a36c-4938-8069-59c6d9127199 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.650015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-381a6fb0-a36c-4938-8069-59c6d9127199 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.650447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-381a6fb0-a36c-4938-8069-59c6d9127199 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.781024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-381a6fb0-a36c-4938-8069-59c6d9127199 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:38.788247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-381a6fb0-a36c-4938-8069-59c6d9127199 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.149766 Jul 28 03:39:38.788802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 203/409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:38 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:38.949756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-317b5e54-ac4e-4f4f-aab5-2a034fb63509 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:38.950367 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-317b5e54-ac4e-4f4f-aab5-2a034fb63509 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:38.956085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-317b5e54-ac4e-4f4f-aab5-2a034fb63509 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.956526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-317b5e54-ac4e-4f4f-aab5-2a034fb63509 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.957282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-317b5e54-ac4e-4f4f-aab5-2a034fb63509 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.957708 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-317b5e54-ac4e-4f4f-aab5-2a034fb63509 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.985146 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Flavor limits 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:39:38.986085 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Image limits 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:39:38.986759 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Flavor pref 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:39:38.987449 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Image pref 0:0:0 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:39:38.988116 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.virt.hardware [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119155) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:39:38.997657 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.998232 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:38.999118 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:38.999805 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:39.018139 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.quota [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Getting quotas for project 55fad6251ff244ea9f24d160e444628f. Resources: {'ram', 'cores', 'instances'} {{(pid=119155) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:39:39.022360 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.quota [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Getting quotas for user 5d6d5c2460744df9ba96e3d336e4747a and project 55fad6251ff244ea9f24d160e444628f. Resources: {'ram', 'cores', 'instances'} {{(pid=119155) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:39:39.034795 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Going to run 1 instances... {{(pid=119155) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:39:39.037206 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119155) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:39:39.092590 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-57c88f19-d130-4d1c-9153-f03ef1c979e7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.269469 Jul 28 03:39:39.093813 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 207/410] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:39:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 3271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:39:39.103763 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a9ba4707-fe00-4aa1-bf5e-145934215e3a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:39.106241 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a9ba4707-fe00-4aa1-bf5e-145934215e3a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:39.122329 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-317b5e54-ac4e-4f4f-aab5-2a034fb63509 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.142375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-317b5e54-ac4e-4f4f-aab5-2a034fb63509 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1511 microversion: 2.1 time: 0.193556 Jul 28 03:39:39.143205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 204/411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:38 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:39.193013 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a9ba4707-fe00-4aa1-bf5e-145934215e3a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.200708 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a9ba4707-fe00-4aa1-bf5e-145934215e3a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1219 microversion: 2.1 time: 0.100667 Jul 28 03:39:39.201351 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 208/412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:39 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:39.478651 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-28a43e3a-8bf9-4477-9c64-7b95ccb2e7e2 req-909d6cbb-6369-42b9-99a4-db0fb262a130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13f1d98-e65b-42e1-b39c-b225093adc02", "name": "network-vif-deleted", "tag": "872503cb-9c95-418a-a479-b2ec51dd5555"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:39.480664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:39.480664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:39:39.492079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-28a43e3a-8bf9-4477-9c64-7b95ccb2e7e2 req-909d6cbb-6369-42b9-99a4-db0fb262a130 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:39.492390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-28a43e3a-8bf9-4477-9c64-7b95ccb2e7e2 req-909d6cbb-6369-42b9-99a4-db0fb262a130 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:39.493061 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f5c0a2c2-9bda-4515-ad4b-c102564d5e0f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:39.493788 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f5c0a2c2-9bda-4515-ad4b-c102564d5e0f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:39.503785 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f5c0a2c2-9bda-4515-ad4b-c102564d5e0f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:39.504647 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f5c0a2c2-9bda-4515-ad4b-c102564d5e0f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:39.506027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-28a43e3a-8bf9-4477-9c64-7b95ccb2e7e2 req-909d6cbb-6369-42b9-99a4-db0fb262a130 service nova] Creating event network-vif-deleted:872503cb-9c95-418a-a479-b2ec51dd5555 for instance a13f1d98-e65b-42e1-b39c-b225093adc02 on hv-cinder-73306 Jul 28 03:39:39.506306 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f5c0a2c2-9bda-4515-ad4b-c102564d5e0f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:39.506999 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f5c0a2c2-9bda-4515-ad4b-c102564d5e0f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:39.512627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-28a43e3a-8bf9-4477-9c64-7b95ccb2e7e2 req-909d6cbb-6369-42b9-99a4-db0fb262a130 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037544 Jul 28 03:39:39.513570 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 205/413] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:39.656927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-85603c7b-e171-4fbc-a6fc-698ba9d99be3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:39.658206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-85603c7b-e171-4fbc-a6fc-698ba9d99be3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:39.664804 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f5c0a2c2-9bda-4515-ad4b-c102564d5e0f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.668524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85603c7b-e171-4fbc-a6fc-698ba9d99be3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:39.669262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85603c7b-e171-4fbc-a6fc-698ba9d99be3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:39.670256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85603c7b-e171-4fbc-a6fc-698ba9d99be3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:39.670870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85603c7b-e171-4fbc-a6fc-698ba9d99be3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:39.674039 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f5c0a2c2-9bda-4515-ad4b-c102564d5e0f tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1504 microversion: 2.1 time: 0.186344 Jul 28 03:39:39.674613 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 209/414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:39 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:39.805619 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2161bafb-9e66-4d95-bc6c-7dd09679b6fa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:39.806299 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2161bafb-9e66-4d95-bc6c-7dd09679b6fa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:39.813274 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2161bafb-9e66-4d95-bc6c-7dd09679b6fa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:39.813836 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2161bafb-9e66-4d95-bc6c-7dd09679b6fa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:39.814627 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2161bafb-9e66-4d95-bc6c-7dd09679b6fa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:39.815061 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2161bafb-9e66-4d95-bc6c-7dd09679b6fa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:39.899049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-85603c7b-e171-4fbc-a6fc-698ba9d99be3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.907025 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-85603c7b-e171-4fbc-a6fc-698ba9d99be3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.908661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-85603c7b-e171-4fbc-a6fc-698ba9d99be3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.910049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-85603c7b-e171-4fbc-a6fc-698ba9d99be3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1718 microversion: 2.20 time: 0.259355 Jul 28 03:39:39.910610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 206/415] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:39 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1718 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:39.941521 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-2161bafb-9e66-4d95-bc6c-7dd09679b6fa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.949756 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2161bafb-9e66-4d95-bc6c-7dd09679b6fa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.148139 Jul 28 03:39:39.950315 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 210/416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:39 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:40.159913 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:40.160648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:40.166489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.167437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:40.168337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.168778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:40.200125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.200578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:40.201027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lazy-loading 'fault' on Instance uuid a13f1d98-e65b-42e1-b39c-b225093adc02 {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:39:40.217059 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-567809bf-5ecd-406f-a2aa-6a006062bfc1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:40.217663 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-567809bf-5ecd-406f-a2aa-6a006062bfc1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:40.223896 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-567809bf-5ecd-406f-a2aa-6a006062bfc1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.224353 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-567809bf-5ecd-406f-a2aa-6a006062bfc1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:40.225128 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-567809bf-5ecd-406f-a2aa-6a006062bfc1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.225567 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-567809bf-5ecd-406f-a2aa-6a006062bfc1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:40.244276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:40.251921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fe9eb689-40e4-4602-bddf-6e10ffcb2914 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 200 len: 1306 microversion: 2.1 time: 0.095677 Jul 28 03:39:40.252494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 207/417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:40 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:40.287021 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-567809bf-5ecd-406f-a2aa-6a006062bfc1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:40.294885 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-567809bf-5ecd-406f-a2aa-6a006062bfc1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1215 microversion: 2.1 time: 0.081525 Jul 28 03:39:40.295440 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 211/418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:40 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:40.693664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-12c54066-91b4-4cea-9381-3a4754a17eaf tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:40.694312 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-12c54066-91b4-4cea-9381-3a4754a17eaf tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:40.700186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-12c54066-91b4-4cea-9381-3a4754a17eaf tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.700634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-12c54066-91b4-4cea-9381-3a4754a17eaf tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:40.701398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-12c54066-91b4-4cea-9381-3a4754a17eaf tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.701832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-12c54066-91b4-4cea-9381-3a4754a17eaf tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:40.824397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-12c54066-91b4-4cea-9381-3a4754a17eaf tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:40.831936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-12c54066-91b4-4cea-9381-3a4754a17eaf tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1504 microversion: 2.1 time: 0.141903 Jul 28 03:39:40.832503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 208/419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:40 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1504 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:40.928302 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b73bf7e9-828f-4f23-9b6f-631a56febf36 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:40.928918 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b73bf7e9-828f-4f23-9b6f-631a56febf36 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:40.934998 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b73bf7e9-828f-4f23-9b6f-631a56febf36 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.935447 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b73bf7e9-828f-4f23-9b6f-631a56febf36 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:40.936251 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b73bf7e9-828f-4f23-9b6f-631a56febf36 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.936687 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b73bf7e9-828f-4f23-9b6f-631a56febf36 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:40.966725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3c1dc402-bdfd-46eb-89db-8768b4cb83b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:40.967258 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3c1dc402-bdfd-46eb-89db-8768b4cb83b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:40.973387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3c1dc402-bdfd-46eb-89db-8768b4cb83b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.973836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3c1dc402-bdfd-46eb-89db-8768b4cb83b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:40.974594 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3c1dc402-bdfd-46eb-89db-8768b4cb83b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:40.975029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3c1dc402-bdfd-46eb-89db-8768b4cb83b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:41.065080 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b73bf7e9-828f-4f23-9b6f-631a56febf36 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:41.074161 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b73bf7e9-828f-4f23-9b6f-631a56febf36 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:41.075991 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b73bf7e9-828f-4f23-9b6f-631a56febf36 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:41.077362 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b73bf7e9-828f-4f23-9b6f-631a56febf36 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1718 microversion: 2.20 time: 0.152734 Jul 28 03:39:41.078003 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 212/420] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:40 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:41.103020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3c1dc402-bdfd-46eb-89db-8768b4cb83b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:41.111289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3c1dc402-bdfd-46eb-89db-8768b4cb83b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.148789 Jul 28 03:39:41.112054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 209/421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:40 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:41.268104 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-13d45608-67ce-4411-a346-47be1049a7a0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.269103 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-13d45608-67ce-4411-a346-47be1049a7a0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: a13f1d98-e65b-42e1-b39c-b225093adc02] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:41.275122 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-13d45608-67ce-4411-a346-47be1049a7a0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:41.275898 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-13d45608-67ce-4411-a346-47be1049a7a0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:41.277093 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-13d45608-67ce-4411-a346-47be1049a7a0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:41.277621 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-13d45608-67ce-4411-a346-47be1049a7a0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:41.294029 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-13d45608-67ce-4411-a346-47be1049a7a0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] HTTP exception thrown: Instance a13f1d98-e65b-42e1-b39c-b225093adc02 could not be found. Jul 28 03:39:41.294765 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-13d45608-67ce-4411-a346-47be1049a7a0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Returning 404 to user: Instance a13f1d98-e65b-42e1-b39c-b225093adc02 could not be found. {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:39:41.295821 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-13d45608-67ce-4411-a346-47be1049a7a0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02" status: 404 len: 111 microversion: 2.1 time: 0.031465 Jul 28 03:39:41.296452 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 213/422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:41 2021] GET /compute/v2.1/servers/a13f1d98-e65b-42e1-b39c-b225093adc02 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:41.314528 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b09b4ddd-1eed-4f87-986d-8482201cf485 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.315158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b09b4ddd-1eed-4f87-986d-8482201cf485 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:41.322048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b09b4ddd-1eed-4f87-986d-8482201cf485 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:41.322561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b09b4ddd-1eed-4f87-986d-8482201cf485 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:41.324184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b09b4ddd-1eed-4f87-986d-8482201cf485 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:41.325346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b09b4ddd-1eed-4f87-986d-8482201cf485 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:41.393609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b09b4ddd-1eed-4f87-986d-8482201cf485 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:41.401291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b09b4ddd-1eed-4f87-986d-8482201cf485 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1289 microversion: 2.1 time: 0.092322 Jul 28 03:39:41.410857 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 210/423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:41 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:41.848743 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-10da1390-bab3-4206-8f9e-781f216767b4 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.849361 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-10da1390-bab3-4206-8f9e-781f216767b4 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:41.856366 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-10da1390-bab3-4206-8f9e-781f216767b4 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:41.856817 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-10da1390-bab3-4206-8f9e-781f216767b4 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:41.857659 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-10da1390-bab3-4206-8f9e-781f216767b4 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:41.858113 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-10da1390-bab3-4206-8f9e-781f216767b4 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.052971 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-10da1390-bab3-4206-8f9e-781f216767b4 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:42.062839 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-10da1390-bab3-4206-8f9e-781f216767b4 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1504 microversion: 2.1 time: 0.217918 Jul 28 03:39:42.063698 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 214/424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:41 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:42.096023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e7874bb0-e8da-466c-8050-9b0ef32a17a6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:42.096646 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e7874bb0-e8da-466c-8050-9b0ef32a17a6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:42.102829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7874bb0-e8da-466c-8050-9b0ef32a17a6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.103562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7874bb0-e8da-466c-8050-9b0ef32a17a6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.105380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7874bb0-e8da-466c-8050-9b0ef32a17a6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.105984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7874bb0-e8da-466c-8050-9b0ef32a17a6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.131224 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-84116318-7c45-4169-9c68-a2f3eafacd83 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:42.132833 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-84116318-7c45-4169-9c68-a2f3eafacd83 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:42.144650 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-84116318-7c45-4169-9c68-a2f3eafacd83 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.145305 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-84116318-7c45-4169-9c68-a2f3eafacd83 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.146830 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-84116318-7c45-4169-9c68-a2f3eafacd83 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.147414 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-84116318-7c45-4169-9c68-a2f3eafacd83 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.299985 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e7874bb0-e8da-466c-8050-9b0ef32a17a6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:42.308469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e7874bb0-e8da-466c-8050-9b0ef32a17a6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:42.310283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e7874bb0-e8da-466c-8050-9b0ef32a17a6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:42.311636 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e7874bb0-e8da-466c-8050-9b0ef32a17a6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1718 microversion: 2.20 time: 0.219649 Jul 28 03:39:42.312698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 211/425] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:42 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1718 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:42.317466 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-5eea2052-e7e1-4923-80d6-71af753588a1 req-3fda7a9a-859e-4e06-b875-38291279b41c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40bb2c6a-5d90-460b-b078-9ac10259aa71", "name": "network-vif-deleted", "tag": "8792223a-d071-4fa7-b0ff-10a8022e1419"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:42.319188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:42.319188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:39:42.327161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5eea2052-e7e1-4923-80d6-71af753588a1 req-3fda7a9a-859e-4e06-b875-38291279b41c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.327878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5eea2052-e7e1-4923-80d6-71af753588a1 req-3fda7a9a-859e-4e06-b875-38291279b41c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.340842 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-5eea2052-e7e1-4923-80d6-71af753588a1 req-3fda7a9a-859e-4e06-b875-38291279b41c service nova] Creating event network-vif-deleted:8792223a-d071-4fa7-b0ff-10a8022e1419 for instance 40bb2c6a-5d90-460b-b078-9ac10259aa71 on hv-cinder-73306 Jul 28 03:39:42.346255 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-5eea2052-e7e1-4923-80d6-71af753588a1 req-3fda7a9a-859e-4e06-b875-38291279b41c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032193 Jul 28 03:39:42.346443 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-84116318-7c45-4169-9c68-a2f3eafacd83 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:42.347518 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 212/426] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:42.358362 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-84116318-7c45-4169-9c68-a2f3eafacd83 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.233510 Jul 28 03:39:42.358929 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 215/427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:42 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:42.418817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-89a19dce-c736-4615-9f08-e9562547b319 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:42.419534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-89a19dce-c736-4615-9f08-e9562547b319 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:42.427294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89a19dce-c736-4615-9f08-e9562547b319 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.427839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89a19dce-c736-4615-9f08-e9562547b319 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.429501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89a19dce-c736-4615-9f08-e9562547b319 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.430266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89a19dce-c736-4615-9f08-e9562547b319 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.450485 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-75661f85-df50-49ee-b1fb-7dff6c0e9f0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:42.451043 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-75661f85-df50-49ee-b1fb-7dff6c0e9f0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:42.456965 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-75661f85-df50-49ee-b1fb-7dff6c0e9f0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.457413 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-75661f85-df50-49ee-b1fb-7dff6c0e9f0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.458191 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-75661f85-df50-49ee-b1fb-7dff6c0e9f0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.458636 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-75661f85-df50-49ee-b1fb-7dff6c0e9f0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.484144 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-75661f85-df50-49ee-b1fb-7dff6c0e9f0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Going to try to terminate instance {{(pid=119155) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:39:42.560089 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-75661f85-df50-49ee-b1fb-7dff6c0e9f0d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 204 len: 0 microversion: 2.1 time: 0.113500 Jul 28 03:39:42.561070 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 216/428] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:39:42 2021] DELETE /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:39:42.568927 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-87ebd887-0555-4376-b5b4-d3b76aad4014 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:42.569732 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-87ebd887-0555-4376-b5b4-d3b76aad4014 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:42.578023 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-87ebd887-0555-4376-b5b4-d3b76aad4014 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.578467 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-87ebd887-0555-4376-b5b4-d3b76aad4014 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.579232 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-87ebd887-0555-4376-b5b4-d3b76aad4014 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.579655 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-87ebd887-0555-4376-b5b4-d3b76aad4014 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.648277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-89a19dce-c736-4615-9f08-e9562547b319 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:42.660244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-89a19dce-c736-4615-9f08-e9562547b319 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.245525 Jul 28 03:39:42.660827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 213/429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:42 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:42.710760 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-87ebd887-0555-4376-b5b4-d3b76aad4014 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:42.718287 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-87ebd887-0555-4376-b5b4-d3b76aad4014 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1513 microversion: 2.1 time: 0.153363 Jul 28 03:39:42.718849 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 217/430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:42 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:42.960549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-3446d10a-1161-452b-97a2-b70c12380e44 req-3c8c2886-7219-4015-8e09-2bffc5c67425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6defc507-3456-460c-94f0-1d954af7997d", "tag": "00ec2991-6499-46ee-92c3-65a3dcb24629"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:42.962166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:42.962166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:39:42.975587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-3446d10a-1161-452b-97a2-b70c12380e44 req-3c8c2886-7219-4015-8e09-2bffc5c67425 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:42.976844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-3446d10a-1161-452b-97a2-b70c12380e44 req-3c8c2886-7219-4015-8e09-2bffc5c67425 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:42.988938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-3446d10a-1161-452b-97a2-b70c12380e44 req-3c8c2886-7219-4015-8e09-2bffc5c67425 service nova] Creating event network-changed:00ec2991-6499-46ee-92c3-65a3dcb24629 for instance 6defc507-3456-460c-94f0-1d954af7997d on hv-cinder-73306 Jul 28 03:39:42.994074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-3446d10a-1161-452b-97a2-b70c12380e44 req-3c8c2886-7219-4015-8e09-2bffc5c67425 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037092 Jul 28 03:39:42.995120 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 214/431] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:43.079436 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:43.080087 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:43.085990 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.086437 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.087201 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.087633 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.124701 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.125139 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.125691 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.objects.instance [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lazy-loading 'fault' on Instance uuid 40bb2c6a-5d90-460b-b078-9ac10259aa71 {{(pid=119155) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:39:43.170452 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db58e38f88a4965a94d51882db44960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390a8b33f669478db43fb9ad4259eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:43.177191 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e63f5c92-6e47-4c83-8313-5437f299fd2e tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 200 len: 1304 microversion: 2.1 time: 0.101510 Jul 28 03:39:43.177743 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 218/432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:43 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:43.330189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-25b6a4a9-221a-4eac-9dc9-59c6a832c17c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:43.331730 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-25b6a4a9-221a-4eac-9dc9-59c6a832c17c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:43.338794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25b6a4a9-221a-4eac-9dc9-59c6a832c17c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.339512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25b6a4a9-221a-4eac-9dc9-59c6a832c17c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.340949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25b6a4a9-221a-4eac-9dc9-59c6a832c17c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.341443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25b6a4a9-221a-4eac-9dc9-59c6a832c17c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.375906 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7f2e8ba9-cac9-4c50-ab20-902df0fa5ede tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:43.376543 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-7f2e8ba9-cac9-4c50-ab20-902df0fa5ede tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:43.385122 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f2e8ba9-cac9-4c50-ab20-902df0fa5ede tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.385599 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f2e8ba9-cac9-4c50-ab20-902df0fa5ede tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.386398 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f2e8ba9-cac9-4c50-ab20-902df0fa5ede tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.393397 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7f2e8ba9-cac9-4c50-ab20-902df0fa5ede tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.533882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-25b6a4a9-221a-4eac-9dc9-59c6a832c17c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:43.544552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-25b6a4a9-221a-4eac-9dc9-59c6a832c17c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:43.546707 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-25b6a4a9-221a-4eac-9dc9-59c6a832c17c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:43.548321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-25b6a4a9-221a-4eac-9dc9-59c6a832c17c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1718 microversion: 2.20 time: 0.222181 Jul 28 03:39:43.549091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 215/433] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:43 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1718 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:43.555327 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-f5f2c173-229a-40b2-af29-f005116625da req-ff9322a9-801d-4587-99d3-f940a4f02709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622af242-a6fc-4f2d-9f03-61e88ee5e89f", "name": "network-vif-unplugged", "status": "completed", "tag": "f743ec9f-b513-4bb3-b819-5c932959e75f"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:43.557627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:43.557627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:39:43.570425 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-7f2e8ba9-cac9-4c50-ab20-902df0fa5ede tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:43.575448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-f5f2c173-229a-40b2-af29-f005116625da req-ff9322a9-801d-4587-99d3-f940a4f02709 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.576566 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-f5f2c173-229a-40b2-af29-f005116625da req-ff9322a9-801d-4587-99d3-f940a4f02709 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.580135 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-7f2e8ba9-cac9-4c50-ab20-902df0fa5ede tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.208704 Jul 28 03:39:43.590761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-f5f2c173-229a-40b2-af29-f005116625da req-ff9322a9-801d-4587-99d3-f940a4f02709 service nova] Creating event network-vif-unplugged:f743ec9f-b513-4bb3-b819-5c932959e75f for instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f on hv-cinder-73306 Jul 28 03:39:43.592335 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 219/434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:43 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:43.596657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-f5f2c173-229a-40b2-af29-f005116625da req-ff9322a9-801d-4587-99d3-f940a4f02709 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046116 Jul 28 03:39:43.597352 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 216/435] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:43.676530 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-179aa484-e031-4d46-98b7-2accb28f3c3b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:43.677130 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-179aa484-e031-4d46-98b7-2accb28f3c3b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:43.683897 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-179aa484-e031-4d46-98b7-2accb28f3c3b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.684793 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-179aa484-e031-4d46-98b7-2accb28f3c3b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.685655 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-179aa484-e031-4d46-98b7-2accb28f3c3b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.686082 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-179aa484-e031-4d46-98b7-2accb28f3c3b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.736674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-90beb6a1-aadc-4a4b-9c2b-9af23c38ea1e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:43.737372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-90beb6a1-aadc-4a4b-9c2b-9af23c38ea1e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:43.743334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90beb6a1-aadc-4a4b-9c2b-9af23c38ea1e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.743817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90beb6a1-aadc-4a4b-9c2b-9af23c38ea1e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.744622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90beb6a1-aadc-4a4b-9c2b-9af23c38ea1e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:43.745357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90beb6a1-aadc-4a4b-9c2b-9af23c38ea1e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:43.817334 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-179aa484-e031-4d46-98b7-2accb28f3c3b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:43.825583 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-179aa484-e031-4d46-98b7-2accb28f3c3b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.152710 Jul 28 03:39:43.826150 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 220/436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:43 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:43.952847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-90beb6a1-aadc-4a4b-9c2b-9af23c38ea1e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:43.960170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-90beb6a1-aadc-4a4b-9c2b-9af23c38ea1e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1513 microversion: 2.1 time: 0.227697 Jul 28 03:39:43.960778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 217/437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:43 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:44.194360 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d51ed3b1-94f0-4e87-a229-7fe948f6c9d1 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:44.195110 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d51ed3b1-94f0-4e87-a229-7fe948f6c9d1 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] [instance: 40bb2c6a-5d90-460b-b078-9ac10259aa71] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:44.201921 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d51ed3b1-94f0-4e87-a229-7fe948f6c9d1 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:44.202453 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d51ed3b1-94f0-4e87-a229-7fe948f6c9d1 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:44.203297 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d51ed3b1-94f0-4e87-a229-7fe948f6c9d1 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:44.203831 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d51ed3b1-94f0-4e87-a229-7fe948f6c9d1 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:44.217616 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-d51ed3b1-94f0-4e87-a229-7fe948f6c9d1 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] HTTP exception thrown: Instance 40bb2c6a-5d90-460b-b078-9ac10259aa71 could not be found. Jul 28 03:39:44.218198 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d51ed3b1-94f0-4e87-a229-7fe948f6c9d1 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] Returning 404 to user: Instance 40bb2c6a-5d90-460b-b078-9ac10259aa71 could not be found. {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:39:44.219011 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d51ed3b1-94f0-4e87-a229-7fe948f6c9d1 tempest-VolumesActionsTest-1286300111 tempest-VolumesActionsTest-1286300111-project] 10.222.0.16 "GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71" status: 404 len: 111 microversion: 2.1 time: 0.028407 Jul 28 03:39:44.219538 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 221/438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:44 2021] GET /compute/v2.1/servers/40bb2c6a-5d90-460b-b078-9ac10259aa71 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:44.569243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bc14982f-1bb3-4481-8b1d-d3709d79ace9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:44.570005 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bc14982f-1bb3-4481-8b1d-d3709d79ace9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:44.575730 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bc14982f-1bb3-4481-8b1d-d3709d79ace9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:44.576296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bc14982f-1bb3-4481-8b1d-d3709d79ace9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:44.577107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bc14982f-1bb3-4481-8b1d-d3709d79ace9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:44.577508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bc14982f-1bb3-4481-8b1d-d3709d79ace9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:44.599247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ff12393d-6f65-46e2-80cc-f3cc239a14b5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:44.600013 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ff12393d-6f65-46e2-80cc-f3cc239a14b5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:44.606562 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff12393d-6f65-46e2-80cc-f3cc239a14b5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:44.607009 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff12393d-6f65-46e2-80cc-f3cc239a14b5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:44.611357 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff12393d-6f65-46e2-80cc-f3cc239a14b5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:44.611869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff12393d-6f65-46e2-80cc-f3cc239a14b5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:44.704825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bc14982f-1bb3-4481-8b1d-d3709d79ace9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:44.714778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bc14982f-1bb3-4481-8b1d-d3709d79ace9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:44.716294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bc14982f-1bb3-4481-8b1d-d3709d79ace9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:44.717424 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bc14982f-1bb3-4481-8b1d-d3709d79ace9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1661 microversion: 2.20 time: 0.151996 Jul 28 03:39:44.718151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 218/439] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:44 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:44.735150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9a8ba875-343b-4a50-ad46-3b20421be52e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e908a9ac-3a6c-481d-b474-846c2a6a441b"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:44.736279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9a8ba875-343b-4a50-ad46-3b20421be52e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:44.739441 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ff12393d-6f65-46e2-80cc-f3cc239a14b5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:44.741979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a8ba875-343b-4a50-ad46-3b20421be52e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:44.742432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a8ba875-343b-4a50-ad46-3b20421be52e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:44.743267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a8ba875-343b-4a50-ad46-3b20421be52e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:44.743701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a8ba875-343b-4a50-ad46-3b20421be52e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:44.748100 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ff12393d-6f65-46e2-80cc-f3cc239a14b5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.153610 Jul 28 03:39:44.748667 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 222/440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:44 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:44.842328 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-bf33581c-dcfe-4114-ba0b-d8894fc465ed tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:44.842945 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-bf33581c-dcfe-4114-ba0b-d8894fc465ed tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:44.849737 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bf33581c-dcfe-4114-ba0b-d8894fc465ed tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:44.850380 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bf33581c-dcfe-4114-ba0b-d8894fc465ed tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:44.851446 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bf33581c-dcfe-4114-ba0b-d8894fc465ed tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:44.852188 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bf33581c-dcfe-4114-ba0b-d8894fc465ed tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:44.996906 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-bf33581c-dcfe-4114-ba0b-d8894fc465ed tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:45.006937 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-bf33581c-dcfe-4114-ba0b-d8894fc465ed tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.168605 Jul 28 03:39:45.008178 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 223/441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:44 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:45.012616 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-81e7230a-35b6-496d-b3f7-6d33c42cc373 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:45.013340 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-81e7230a-35b6-496d-b3f7-6d33c42cc373 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:45.022636 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-81e7230a-35b6-496d-b3f7-6d33c42cc373 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:45.023314 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-81e7230a-35b6-496d-b3f7-6d33c42cc373 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:45.024346 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-81e7230a-35b6-496d-b3f7-6d33c42cc373 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:45.024972 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-81e7230a-35b6-496d-b3f7-6d33c42cc373 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:45.038741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9a8ba875-343b-4a50-ad46-3b20421be52e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307246 Jul 28 03:39:45.039428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 219/442] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Jul 28 03:39:44 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:39:45.106124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-af36616b-82d9-47c7-8aa5-d337f568c830 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:45.106888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-af36616b-82d9-47c7-8aa5-d337f568c830 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:45.116316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af36616b-82d9-47c7-8aa5-d337f568c830 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:45.116770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af36616b-82d9-47c7-8aa5-d337f568c830 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:45.117627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af36616b-82d9-47c7-8aa5-d337f568c830 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:45.118066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af36616b-82d9-47c7-8aa5-d337f568c830 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:45.159605 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-81e7230a-35b6-496d-b3f7-6d33c42cc373 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:45.167545 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-81e7230a-35b6-496d-b3f7-6d33c42cc373 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1513 microversion: 2.1 time: 0.157997 Jul 28 03:39:45.168100 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 224/443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:45 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:45.196133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-af36616b-82d9-47c7-8aa5-d337f568c830 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action" status: 202 len: 0 microversion: 2.20 time: 0.094166 Jul 28 03:39:45.196726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 220/444] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:39:45 2021] POST /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:39:45.204740 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-47b4f22a-074f-4a81-af2a-6846163d6c43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:45.205456 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-47b4f22a-074f-4a81-af2a-6846163d6c43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:45.211429 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47b4f22a-074f-4a81-af2a-6846163d6c43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:45.212013 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47b4f22a-074f-4a81-af2a-6846163d6c43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:45.212857 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47b4f22a-074f-4a81-af2a-6846163d6c43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:45.213926 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47b4f22a-074f-4a81-af2a-6846163d6c43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:45.341709 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-47b4f22a-074f-4a81-af2a-6846163d6c43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:45.350440 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-47b4f22a-074f-4a81-af2a-6846163d6c43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:45.351992 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-47b4f22a-074f-4a81-af2a-6846163d6c43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:45.353105 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-47b4f22a-074f-4a81-af2a-6846163d6c43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1747 microversion: 2.20 time: 0.152084 Jul 28 03:39:45.353642 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 225/445] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:45 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:45.458001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1243592104", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-450332115", "security_groups": [{"name": "tempest-secgroup-smoke-1747876259"}], "networks": [{"uuid": "b25cc0de-ded2-4f06-a5ba-088ba3628bb5"}], "block_device_mapping_v2": [{"uuid": "4a22a427-dcf0-4de3-a8d3-c7a42fdca00e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:45.566029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] validate_networks() for [('b25cc0de-ded2-4f06-a5ba-088ba3628bb5', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:39:45.764914 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8b22fd7d-13ab-438f-bcc9-bebd17c8751f tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:45.765602 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8b22fd7d-13ab-438f-bcc9-bebd17c8751f tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:45.772742 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8b22fd7d-13ab-438f-bcc9-bebd17c8751f tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:45.773628 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8b22fd7d-13ab-438f-bcc9-bebd17c8751f tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:45.774548 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8b22fd7d-13ab-438f-bcc9-bebd17c8751f tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:45.775061 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8b22fd7d-13ab-438f-bcc9-bebd17c8751f tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:45.918725 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-8b22fd7d-13ab-438f-bcc9-bebd17c8751f tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:45.928150 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8b22fd7d-13ab-438f-bcc9-bebd17c8751f tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.167265 Jul 28 03:39:45.928852 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 226/446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:45 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:45.939263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:39:45.939753 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:39:45.940160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:39:45.940562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:39:45.940968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:39:45.949970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:45.950408 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:45.951194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:45.951622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:45.967145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Getting quotas for project dcfeb19e3a6d42cfbf29ba7e9a7aeacf. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:39:45.971227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Getting quotas for user b539456ade66487fabf02e41879bbb45 and project dcfeb19e3a6d42cfbf29ba7e9a7aeacf. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:39:46.024293 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-eaa0a7bf-cd5d-4e7b-bad1-6d5a93bb8671 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:46.024901 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-eaa0a7bf-cd5d-4e7b-bad1-6d5a93bb8671 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:46.031062 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-eaa0a7bf-cd5d-4e7b-bad1-6d5a93bb8671 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:46.031508 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-eaa0a7bf-cd5d-4e7b-bad1-6d5a93bb8671 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:46.031627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:39:46.032305 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-eaa0a7bf-cd5d-4e7b-bad1-6d5a93bb8671 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:46.032750 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-eaa0a7bf-cd5d-4e7b-bad1-6d5a93bb8671 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:46.033788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a22a427-dcf0-4de3-a8d3-c7a42fdca00e',volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:39:46.160530 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-eaa0a7bf-cd5d-4e7b-bad1-6d5a93bb8671 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:46.161400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-211ccc19-06e9-416f-851b-ee2213b47036 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.707467 Jul 28 03:39:46.167507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 221/447] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:39:45 2021] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:39:46.172453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-aabf3816-c6e9-4a69-98e1-dfd06f29800d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:46.173075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-aabf3816-c6e9-4a69-98e1-dfd06f29800d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:46.174911 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-eaa0a7bf-cd5d-4e7b-bad1-6d5a93bb8671 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.154215 Jul 28 03:39:46.185697 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 227/448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:46 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:46.185697 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2d1b27f9-1ae9-4a1b-af71-17acc42accd6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:46.185954 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2d1b27f9-1ae9-4a1b-af71-17acc42accd6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:46.192382 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d1b27f9-1ae9-4a1b-af71-17acc42accd6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:46.193012 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d1b27f9-1ae9-4a1b-af71-17acc42accd6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:46.193971 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d1b27f9-1ae9-4a1b-af71-17acc42accd6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:46.194576 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2d1b27f9-1ae9-4a1b-af71-17acc42accd6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:46.234028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-aabf3816-c6e9-4a69-98e1-dfd06f29800d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:46.241231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-aabf3816-c6e9-4a69-98e1-dfd06f29800d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1088 microversion: 2.1 time: 0.072364 Jul 28 03:39:46.241813 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 222/449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:46 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:46.322944 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-2d1b27f9-1ae9-4a1b-af71-17acc42accd6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:46.331156 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2d1b27f9-1ae9-4a1b-af71-17acc42accd6 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1513 microversion: 2.1 time: 0.150390 Jul 28 03:39:46.332068 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 228/450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:46 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:46.371822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-98a1adbe-e079-4dac-879e-b755b0c63d43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:46.372434 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-98a1adbe-e079-4dac-879e-b755b0c63d43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:46.378270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98a1adbe-e079-4dac-879e-b755b0c63d43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:46.378718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98a1adbe-e079-4dac-879e-b755b0c63d43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:46.379487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98a1adbe-e079-4dac-879e-b755b0c63d43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:46.379950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98a1adbe-e079-4dac-879e-b755b0c63d43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:46.506943 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-98a1adbe-e079-4dac-879e-b755b0c63d43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:46.516888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-98a1adbe-e079-4dac-879e-b755b0c63d43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:46.518331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-98a1adbe-e079-4dac-879e-b755b0c63d43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:46.519471 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-98a1adbe-e079-4dac-879e-b755b0c63d43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1747 microversion: 2.20 time: 0.152738 Jul 28 03:39:46.520048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 223/451] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:46 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:46.948866 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b52108f3-5dcb-46ff-9392-1d2ce832b56b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:46.949473 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b52108f3-5dcb-46ff-9392-1d2ce832b56b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:46.955246 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b52108f3-5dcb-46ff-9392-1d2ce832b56b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:46.955684 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b52108f3-5dcb-46ff-9392-1d2ce832b56b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:46.956463 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b52108f3-5dcb-46ff-9392-1d2ce832b56b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:46.956891 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b52108f3-5dcb-46ff-9392-1d2ce832b56b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:47.079393 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b52108f3-5dcb-46ff-9392-1d2ce832b56b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:47.086530 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b52108f3-5dcb-46ff-9392-1d2ce832b56b tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.142196 Jul 28 03:39:47.087074 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 229/452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:46 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:47.191866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-39d36f1f-9344-4973-8685-57e609bccc0e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:47.192479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-39d36f1f-9344-4973-8685-57e609bccc0e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:47.199125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-39d36f1f-9344-4973-8685-57e609bccc0e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:47.199506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-39d36f1f-9344-4973-8685-57e609bccc0e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:47.200331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-39d36f1f-9344-4973-8685-57e609bccc0e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:47.200752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-39d36f1f-9344-4973-8685-57e609bccc0e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:47.258144 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a62244a7-72a9-4c74-9415-4fddd96fd3b0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:47.258753 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a62244a7-72a9-4c74-9415-4fddd96fd3b0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:47.264886 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a62244a7-72a9-4c74-9415-4fddd96fd3b0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:47.265339 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a62244a7-72a9-4c74-9415-4fddd96fd3b0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:47.266117 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a62244a7-72a9-4c74-9415-4fddd96fd3b0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:47.266552 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a62244a7-72a9-4c74-9415-4fddd96fd3b0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:47.320577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-39d36f1f-9344-4973-8685-57e609bccc0e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:47.324801 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a62244a7-72a9-4c74-9415-4fddd96fd3b0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:47.328119 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-39d36f1f-9344-4973-8685-57e609bccc0e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.139949 Jul 28 03:39:47.328767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 224/453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:47 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:47.331864 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a62244a7-72a9-4c74-9415-4fddd96fd3b0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1138 microversion: 2.1 time: 0.077336 Jul 28 03:39:47.332412 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 230/454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:47 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1138 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:47.347910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-68d8585c-f5af-4906-923f-ee344c84242f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:47.348517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-68d8585c-f5af-4906-923f-ee344c84242f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:47.354849 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68d8585c-f5af-4906-923f-ee344c84242f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:47.355439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68d8585c-f5af-4906-923f-ee344c84242f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:47.356235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68d8585c-f5af-4906-923f-ee344c84242f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:47.356668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68d8585c-f5af-4906-923f-ee344c84242f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:47.477913 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-68d8585c-f5af-4906-923f-ee344c84242f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:47.485975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-68d8585c-f5af-4906-923f-ee344c84242f tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1513 microversion: 2.1 time: 0.141870 Jul 28 03:39:47.486540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 225/455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:47 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:47.537352 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ead5fc4a-ac3d-467a-9dfc-6ece9cde095e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:47.537951 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ead5fc4a-ac3d-467a-9dfc-6ece9cde095e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:47.544491 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ead5fc4a-ac3d-467a-9dfc-6ece9cde095e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:47.544935 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ead5fc4a-ac3d-467a-9dfc-6ece9cde095e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:47.545692 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ead5fc4a-ac3d-467a-9dfc-6ece9cde095e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:47.546119 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ead5fc4a-ac3d-467a-9dfc-6ece9cde095e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:47.665272 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ead5fc4a-ac3d-467a-9dfc-6ece9cde095e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:47.677617 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ead5fc4a-ac3d-467a-9dfc-6ece9cde095e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:47.679257 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ead5fc4a-ac3d-467a-9dfc-6ece9cde095e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:47.680728 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ead5fc4a-ac3d-467a-9dfc-6ece9cde095e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1747 microversion: 2.20 time: 0.146837 Jul 28 03:39:47.681289 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 231/456] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:47 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1747 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:48.103496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-36629aca-a8af-4987-ac6f-15d5d7cb4132 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:48.104141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-36629aca-a8af-4987-ac6f-15d5d7cb4132 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:48.110417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-36629aca-a8af-4987-ac6f-15d5d7cb4132 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:48.110863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-36629aca-a8af-4987-ac6f-15d5d7cb4132 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:48.111752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-36629aca-a8af-4987-ac6f-15d5d7cb4132 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:48.112189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-36629aca-a8af-4987-ac6f-15d5d7cb4132 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:48.241556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-36629aca-a8af-4987-ac6f-15d5d7cb4132 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:48.249978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-36629aca-a8af-4987-ac6f-15d5d7cb4132 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.149922 Jul 28 03:39:48.250889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 226/457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:48 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:48.344667 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-00638c02-a039-42d0-80f7-813824ea8d45 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:48.346137 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-00638c02-a039-42d0-80f7-813824ea8d45 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:48.350365 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-90015575-ef9b-4092-95d2-7b68d2c86dff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:48.351178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-90015575-ef9b-4092-95d2-7b68d2c86dff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:48.352765 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-00638c02-a039-42d0-80f7-813824ea8d45 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:48.353373 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-00638c02-a039-42d0-80f7-813824ea8d45 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:48.354806 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-00638c02-a039-42d0-80f7-813824ea8d45 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:48.355394 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-00638c02-a039-42d0-80f7-813824ea8d45 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:48.358773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90015575-ef9b-4092-95d2-7b68d2c86dff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:48.359620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90015575-ef9b-4092-95d2-7b68d2c86dff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:48.360518 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90015575-ef9b-4092-95d2-7b68d2c86dff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:48.361568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90015575-ef9b-4092-95d2-7b68d2c86dff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:48.426980 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-90015575-ef9b-4092-95d2-7b68d2c86dff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:48.435273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-90015575-ef9b-4092-95d2-7b68d2c86dff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1186 microversion: 2.1 time: 0.089515 Jul 28 03:39:48.435878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 227/458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:48 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:48.484869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-00638c02-a039-42d0-80f7-813824ea8d45 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:48.492153 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-00638c02-a039-42d0-80f7-813824ea8d45 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.151280 Jul 28 03:39:48.492720 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 232/459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:48 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:48.502778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5b6239f7-e81c-4e9d-9f60-6a5e08a6b52d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:48.503264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5b6239f7-e81c-4e9d-9f60-6a5e08a6b52d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:48.509609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b6239f7-e81c-4e9d-9f60-6a5e08a6b52d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:48.510101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b6239f7-e81c-4e9d-9f60-6a5e08a6b52d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:48.511040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b6239f7-e81c-4e9d-9f60-6a5e08a6b52d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:48.511452 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b6239f7-e81c-4e9d-9f60-6a5e08a6b52d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:48.699117 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b1c31a16-7c87-4c38-a836-0ecf486a0d69 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:48.700902 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b1c31a16-7c87-4c38-a836-0ecf486a0d69 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:48.704902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5b6239f7-e81c-4e9d-9f60-6a5e08a6b52d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:48.707760 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b1c31a16-7c87-4c38-a836-0ecf486a0d69 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:48.708273 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b1c31a16-7c87-4c38-a836-0ecf486a0d69 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:48.709112 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b1c31a16-7c87-4c38-a836-0ecf486a0d69 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:48.709687 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b1c31a16-7c87-4c38-a836-0ecf486a0d69 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:48.715146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5b6239f7-e81c-4e9d-9f60-6a5e08a6b52d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1513 microversion: 2.1 time: 0.214452 Jul 28 03:39:48.715146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 228/460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:48 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:48.834267 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b1c31a16-7c87-4c38-a836-0ecf486a0d69 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:48.843144 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b1c31a16-7c87-4c38-a836-0ecf486a0d69 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:48.844663 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b1c31a16-7c87-4c38-a836-0ecf486a0d69 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:48.846080 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b1c31a16-7c87-4c38-a836-0ecf486a0d69 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1749 microversion: 2.20 time: 0.150981 Jul 28 03:39:48.846628 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 233/461] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:48 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1749 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:49.018069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-a437c21d-06ff-4bbe-b4fb-38800fa3f97f req-fbed0893-62d8-430e-89c4-71d2f89f59eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4063b183-9e13-41da-9c3d-66ad0e28d877", "name": "network-vif-deleted", "tag": "89207e90-606c-4b3a-ac81-aead843125ef"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:49.021689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:49.021689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:39:49.031866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-a437c21d-06ff-4bbe-b4fb-38800fa3f97f req-fbed0893-62d8-430e-89c4-71d2f89f59eb service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.032437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-a437c21d-06ff-4bbe-b4fb-38800fa3f97f req-fbed0893-62d8-430e-89c4-71d2f89f59eb service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.047985 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-a437c21d-06ff-4bbe-b4fb-38800fa3f97f req-fbed0893-62d8-430e-89c4-71d2f89f59eb service nova] Creating event network-vif-deleted:89207e90-606c-4b3a-ac81-aead843125ef for instance 4063b183-9e13-41da-9c3d-66ad0e28d877 on hv-cinder-73306 Jul 28 03:39:49.053088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-a437c21d-06ff-4bbe-b4fb-38800fa3f97f req-fbed0893-62d8-430e-89c4-71d2f89f59eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038831 Jul 28 03:39:49.053661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 229/462] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:49.266380 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-470312a2-e08d-4fad-9e60-a0ea4949bea5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:49.266993 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-470312a2-e08d-4fad-9e60-a0ea4949bea5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:49.272877 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-470312a2-e08d-4fad-9e60-a0ea4949bea5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.273328 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-470312a2-e08d-4fad-9e60-a0ea4949bea5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.274094 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-470312a2-e08d-4fad-9e60-a0ea4949bea5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.274528 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-470312a2-e08d-4fad-9e60-a0ea4949bea5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.419082 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-470312a2-e08d-4fad-9e60-a0ea4949bea5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:49.439423 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-470312a2-e08d-4fad-9e60-a0ea4949bea5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.176631 Jul 28 03:39:49.448931 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 234/463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:49 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:49.454997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a7b6b55e-bd95-45d1-8863-1a11fac3aa46 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:49.455698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a7b6b55e-bd95-45d1-8863-1a11fac3aa46 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:49.465387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a7b6b55e-bd95-45d1-8863-1a11fac3aa46 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.466211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a7b6b55e-bd95-45d1-8863-1a11fac3aa46 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.467370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a7b6b55e-bd95-45d1-8863-1a11fac3aa46 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.468295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a7b6b55e-bd95-45d1-8863-1a11fac3aa46 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.508788 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-08a5fb9a-5571-4982-9855-24df1098d835 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:49.509405 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-08a5fb9a-5571-4982-9855-24df1098d835 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:49.519201 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-08a5fb9a-5571-4982-9855-24df1098d835 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.519665 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-08a5fb9a-5571-4982-9855-24df1098d835 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.520485 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-08a5fb9a-5571-4982-9855-24df1098d835 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.521201 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-08a5fb9a-5571-4982-9855-24df1098d835 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.559980 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a7b6b55e-bd95-45d1-8863-1a11fac3aa46 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:49.571455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a7b6b55e-bd95-45d1-8863-1a11fac3aa46 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1204 microversion: 2.1 time: 0.120952 Jul 28 03:39:49.574212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 230/464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:49 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1204 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:49.705037 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-08a5fb9a-5571-4982-9855-24df1098d835 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:49.717682 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-08a5fb9a-5571-4982-9855-24df1098d835 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.212565 Jul 28 03:39:49.719781 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 235/465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:49 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:49.744799 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:49.745665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:49.755401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.755894 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.756775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.757230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.809633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.810370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.810993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lazy-loading 'fault' on Instance uuid 4063b183-9e13-41da-9c3d-66ad0e28d877 {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:39:49.869642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:49.869993 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e10e910c-bf28-41d1-be8f-9ae306235c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:49.875922 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e10e910c-bf28-41d1-be8f-9ae306235c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:49.880733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-65e54d36-1a5f-44b2-a65f-fab111cc2ece tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 200 len: 1307 microversion: 2.1 time: 0.151730 Jul 28 03:39:49.881616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 231/466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:49 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 1307 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:49.887662 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e10e910c-bf28-41d1-be8f-9ae306235c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.888991 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e10e910c-bf28-41d1-be8f-9ae306235c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:49.889932 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e10e910c-bf28-41d1-be8f-9ae306235c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:49.890510 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e10e910c-bf28-41d1-be8f-9ae306235c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:50.154592 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e10e910c-bf28-41d1-be8f-9ae306235c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:50.182644 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e10e910c-bf28-41d1-be8f-9ae306235c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:50.184543 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e10e910c-bf28-41d1-be8f-9ae306235c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:50.185707 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e10e910c-bf28-41d1-be8f-9ae306235c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.324670 Jul 28 03:39:50.205702 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 236/467] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:49 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:50.457188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-679bc09a-1451-4367-81be-0ec55788c506 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:50.458546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-679bc09a-1451-4367-81be-0ec55788c506 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:50.466825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-679bc09a-1451-4367-81be-0ec55788c506 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:50.488235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-679bc09a-1451-4367-81be-0ec55788c506 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:50.489777 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-679bc09a-1451-4367-81be-0ec55788c506 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:50.490769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-679bc09a-1451-4367-81be-0ec55788c506 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:50.589912 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-3acf270c-a6f7-427a-ab08-cf72918a01a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:50.590549 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-3acf270c-a6f7-427a-ab08-cf72918a01a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:50.605178 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3acf270c-a6f7-427a-ab08-cf72918a01a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:50.605628 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3acf270c-a6f7-427a-ab08-cf72918a01a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:50.606419 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3acf270c-a6f7-427a-ab08-cf72918a01a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:50.606853 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3acf270c-a6f7-427a-ab08-cf72918a01a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:50.798582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-679bc09a-1451-4367-81be-0ec55788c506 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:50.808861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-679bc09a-1451-4367-81be-0ec55788c506 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.354678 Jul 28 03:39:50.809475 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 232/468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:50 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:50.820018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8a9e7ed4-d9bc-4805-b6ea-b4c9e94b8810 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:50.823862 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8a9e7ed4-d9bc-4805-b6ea-b4c9e94b8810 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:50.839859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a9e7ed4-d9bc-4805-b6ea-b4c9e94b8810 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:50.840642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a9e7ed4-d9bc-4805-b6ea-b4c9e94b8810 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:50.841750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a9e7ed4-d9bc-4805-b6ea-b4c9e94b8810 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:50.843059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a9e7ed4-d9bc-4805-b6ea-b4c9e94b8810 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:50.874162 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3acf270c-a6f7-427a-ab08-cf72918a01a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:50.884607 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-3acf270c-a6f7-427a-ab08-cf72918a01a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.298948 Jul 28 03:39:50.903154 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 237/469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:50 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:50.914889 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-84ca15d5-1d20-4efb-be22-838b7ed33e4c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:50.915801 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-84ca15d5-1d20-4efb-be22-838b7ed33e4c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 4063b183-9e13-41da-9c3d-66ad0e28d877] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:50.928033 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-84ca15d5-1d20-4efb-be22-838b7ed33e4c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:50.932467 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-84ca15d5-1d20-4efb-be22-838b7ed33e4c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:50.934115 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-84ca15d5-1d20-4efb-be22-838b7ed33e4c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:50.934755 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-84ca15d5-1d20-4efb-be22-838b7ed33e4c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:50.965467 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-84ca15d5-1d20-4efb-be22-838b7ed33e4c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] HTTP exception thrown: Instance 4063b183-9e13-41da-9c3d-66ad0e28d877 could not be found. Jul 28 03:39:50.966392 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-84ca15d5-1d20-4efb-be22-838b7ed33e4c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Returning 404 to user: Instance 4063b183-9e13-41da-9c3d-66ad0e28d877 could not be found. {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:39:50.967459 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-84ca15d5-1d20-4efb-be22-838b7ed33e4c tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877" status: 404 len: 111 microversion: 2.1 time: 0.062964 Jul 28 03:39:50.968273 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 238/470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:50 2021] GET /compute/v2.1/servers/4063b183-9e13-41da-9c3d-66ad0e28d877 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:50.978417 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b6f5060e-66ac-41b1-9a81-7b71cc52fe48 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:50.980306 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b6f5060e-66ac-41b1-9a81-7b71cc52fe48 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:51.004816 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b6f5060e-66ac-41b1-9a81-7b71cc52fe48 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.006170 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b6f5060e-66ac-41b1-9a81-7b71cc52fe48 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:51.007246 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b6f5060e-66ac-41b1-9a81-7b71cc52fe48 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.008103 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b6f5060e-66ac-41b1-9a81-7b71cc52fe48 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:51.045389 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b6f5060e-66ac-41b1-9a81-7b71cc52fe48 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Going to try to terminate instance {{(pid=119155) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:39:51.193391 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b6f5060e-66ac-41b1-9a81-7b71cc52fe48 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 204 len: 0 microversion: 2.1 time: 0.219281 Jul 28 03:39:51.195084 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 239/471] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:39:50 2021] DELETE /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:39:51.209208 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8a9e7ed4-d9bc-4805-b6ea-b4c9e94b8810 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:51.217861 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d1e8c937-22db-4758-973c-7dfc1d9886c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:51.218049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8a9e7ed4-d9bc-4805-b6ea-b4c9e94b8810 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.406406 Jul 28 03:39:51.218781 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 233/472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:50 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:51.218890 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d1e8c937-22db-4758-973c-7dfc1d9886c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:51.232317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-db00553a-8fb0-41e1-a44f-5c5cb45c34ae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:51.232611 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d1e8c937-22db-4758-973c-7dfc1d9886c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.232919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-db00553a-8fb0-41e1-a44f-5c5cb45c34ae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:51.233039 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d1e8c937-22db-4758-973c-7dfc1d9886c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:51.233796 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d1e8c937-22db-4758-973c-7dfc1d9886c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.234226 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d1e8c937-22db-4758-973c-7dfc1d9886c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:51.239223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db00553a-8fb0-41e1-a44f-5c5cb45c34ae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.239391 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db00553a-8fb0-41e1-a44f-5c5cb45c34ae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:51.240139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db00553a-8fb0-41e1-a44f-5c5cb45c34ae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.240833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db00553a-8fb0-41e1-a44f-5c5cb45c34ae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:51.496088 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d1e8c937-22db-4758-973c-7dfc1d9886c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:51.513158 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d1e8c937-22db-4758-973c-7dfc1d9886c9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.307669 Jul 28 03:39:51.514066 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 240/473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:51 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:51.523380 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-a128c9f3-a8db-427c-833c-76d4126f53c7 req-a4889e20-fa50-4a72-8629-29bf71c1a13f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e", "tag": "fbcce620-dcf6-4f36-b99e-42b820797a20"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:51.533276 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:51.533276 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:39:51.552402 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-a128c9f3-a8db-427c-833c-76d4126f53c7 req-a4889e20-fa50-4a72-8629-29bf71c1a13f service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.552755 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-a128c9f3-a8db-427c-833c-76d4126f53c7 req-a4889e20-fa50-4a72-8629-29bf71c1a13f service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:51.587075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-db00553a-8fb0-41e1-a44f-5c5cb45c34ae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:51.599912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-db00553a-8fb0-41e1-a44f-5c5cb45c34ae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:51.608465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-db00553a-8fb0-41e1-a44f-5c5cb45c34ae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:51.613283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-db00553a-8fb0-41e1-a44f-5c5cb45c34ae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.384850 Jul 28 03:39:51.614049 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-a128c9f3-a8db-427c-833c-76d4126f53c7 req-a4889e20-fa50-4a72-8629-29bf71c1a13f service nova] Creating event network-changed:fbcce620-dcf6-4f36-b99e-42b820797a20 for instance cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e on hv-cinder-73306 Jul 28 03:39:51.616003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 234/474] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:51 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:51.625521 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-a128c9f3-a8db-427c-833c-76d4126f53c7 req-a4889e20-fa50-4a72-8629-29bf71c1a13f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110368 Jul 28 03:39:51.628169 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 241/475] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:51.832883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1ed3f5dc-b418-4959-9136-952861573478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:51.833483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1ed3f5dc-b418-4959-9136-952861573478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:51.847246 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ed3f5dc-b418-4959-9136-952861573478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.852020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ed3f5dc-b418-4959-9136-952861573478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:51.857177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ed3f5dc-b418-4959-9136-952861573478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.857748 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ed3f5dc-b418-4959-9136-952861573478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:51.910310 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-97135aca-cd04-4cb9-8c73-89d10eb7761d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:51.911329 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-97135aca-cd04-4cb9-8c73-89d10eb7761d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:51.917891 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-97135aca-cd04-4cb9-8c73-89d10eb7761d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.918533 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-97135aca-cd04-4cb9-8c73-89d10eb7761d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:51.919458 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-97135aca-cd04-4cb9-8c73-89d10eb7761d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:51.920062 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-97135aca-cd04-4cb9-8c73-89d10eb7761d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:52.004587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1ed3f5dc-b418-4959-9136-952861573478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:52.013248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1ed3f5dc-b418-4959-9136-952861573478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.191780 Jul 28 03:39:52.023494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 235/476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:51 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:52.069332 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-97135aca-cd04-4cb9-8c73-89d10eb7761d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:52.077684 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-97135aca-cd04-4cb9-8c73-89d10eb7761d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.174474 Jul 28 03:39:52.078230 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 242/477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:51 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:52.238497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e8e0578c-28b4-419b-9662-c033b3645b8b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:52.240838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e8e0578c-28b4-419b-9662-c033b3645b8b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:52.251988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8e0578c-28b4-419b-9662-c033b3645b8b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:52.252537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8e0578c-28b4-419b-9662-c033b3645b8b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:52.253616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8e0578c-28b4-419b-9662-c033b3645b8b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:52.254168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8e0578c-28b4-419b-9662-c033b3645b8b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:52.531123 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fdd34083-346e-4f8a-be12-86a6bfde3ebb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:52.531752 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-fdd34083-346e-4f8a-be12-86a6bfde3ebb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:52.537785 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fdd34083-346e-4f8a-be12-86a6bfde3ebb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:52.538229 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fdd34083-346e-4f8a-be12-86a6bfde3ebb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:52.539007 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fdd34083-346e-4f8a-be12-86a6bfde3ebb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:52.539434 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fdd34083-346e-4f8a-be12-86a6bfde3ebb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:52.728001 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-fdd34083-346e-4f8a-be12-86a6bfde3ebb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:52.738712 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-fdd34083-346e-4f8a-be12-86a6bfde3ebb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.211109 Jul 28 03:39:52.739626 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 243/478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:52 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:52.755112 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7507c9a2-3a9d-409b-ab16-f0de1bd33808 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:52.756687 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-7507c9a2-3a9d-409b-ab16-f0de1bd33808 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:52.789055 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7507c9a2-3a9d-409b-ab16-f0de1bd33808 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:52.790757 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7507c9a2-3a9d-409b-ab16-f0de1bd33808 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:52.795330 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7507c9a2-3a9d-409b-ab16-f0de1bd33808 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:52.796184 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7507c9a2-3a9d-409b-ab16-f0de1bd33808 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:53.013128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e8e0578c-28b4-419b-9662-c033b3645b8b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:53.041183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e8e0578c-28b4-419b-9662-c033b3645b8b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.808573 Jul 28 03:39:53.045476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 236/479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:52 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:53.078689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-da5b05fc-7311-48e6-aa2a-7df9467b605d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:53.079297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-da5b05fc-7311-48e6-aa2a-7df9467b605d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:53.106066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-da5b05fc-7311-48e6-aa2a-7df9467b605d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:53.108472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-da5b05fc-7311-48e6-aa2a-7df9467b605d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:53.111235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-da5b05fc-7311-48e6-aa2a-7df9467b605d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:53.112983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-da5b05fc-7311-48e6-aa2a-7df9467b605d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:53.214512 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-7507c9a2-3a9d-409b-ab16-f0de1bd33808 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:53.234476 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-7507c9a2-3a9d-409b-ab16-f0de1bd33808 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:53.236451 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-7507c9a2-3a9d-409b-ab16-f0de1bd33808 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:53.237957 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-7507c9a2-3a9d-409b-ab16-f0de1bd33808 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.497038 Jul 28 03:39:53.238504 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 244/480] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:52 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:53.253877 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-10477b12-6bd1-493c-ae33-26db49211b1e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:53.254302 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-10477b12-6bd1-493c-ae33-26db49211b1e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:53.267398 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-10477b12-6bd1-493c-ae33-26db49211b1e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:53.267869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-10477b12-6bd1-493c-ae33-26db49211b1e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:53.268932 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-10477b12-6bd1-493c-ae33-26db49211b1e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:53.269365 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-10477b12-6bd1-493c-ae33-26db49211b1e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:53.368615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-da5b05fc-7311-48e6-aa2a-7df9467b605d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:53.381232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-da5b05fc-7311-48e6-aa2a-7df9467b605d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1521 microversion: 2.1 time: 0.306672 Jul 28 03:39:53.382619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 237/481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:53 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:53.548299 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-10477b12-6bd1-493c-ae33-26db49211b1e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:53.569255 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-10477b12-6bd1-493c-ae33-26db49211b1e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.328357 Jul 28 03:39:53.570194 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 245/482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:53 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:53.758665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-596cede1-0f06-47af-98b0-3d0217f860ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:53.759267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-596cede1-0f06-47af-98b0-3d0217f860ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:53.766874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-596cede1-0f06-47af-98b0-3d0217f860ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:53.768069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-596cede1-0f06-47af-98b0-3d0217f860ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:53.769247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-596cede1-0f06-47af-98b0-3d0217f860ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:53.770215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-596cede1-0f06-47af-98b0-3d0217f860ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.010387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-596cede1-0f06-47af-98b0-3d0217f860ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:54.018596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-596cede1-0f06-47af-98b0-3d0217f860ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.263952 Jul 28 03:39:54.019901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 238/483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:53 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:54.061508 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0e5bffcf-962e-4979-92f0-282a67be384e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:54.063324 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0e5bffcf-962e-4979-92f0-282a67be384e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:54.069964 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0e5bffcf-962e-4979-92f0-282a67be384e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.070769 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0e5bffcf-962e-4979-92f0-282a67be384e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.072065 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0e5bffcf-962e-4979-92f0-282a67be384e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.073478 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0e5bffcf-962e-4979-92f0-282a67be384e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.258745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-19f8a742-61e4-4892-865d-cc78c762cd57 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:54.259425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-19f8a742-61e4-4892-865d-cc78c762cd57 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:54.271234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19f8a742-61e4-4892-865d-cc78c762cd57 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.271901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19f8a742-61e4-4892-865d-cc78c762cd57 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.272975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19f8a742-61e4-4892-865d-cc78c762cd57 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.273408 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19f8a742-61e4-4892-865d-cc78c762cd57 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.333262 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0e5bffcf-962e-4979-92f0-282a67be384e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:54.344666 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0e5bffcf-962e-4979-92f0-282a67be384e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.286307 Jul 28 03:39:54.356617 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 246/484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:54 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:54.368499 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-60e6490f-85fd-428a-949e-1bafcb01cbc4 req-7ea643a3-6c97-4bf2-ac2a-b53475d99d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6defc507-3456-460c-94f0-1d954af7997d", "name": "network-vif-plugged", "status": "completed", "tag": "00ec2991-6499-46ee-92c3-65a3dcb24629"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:54.370418 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:54.370418 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:39:54.401809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-60e6490f-85fd-428a-949e-1bafcb01cbc4 req-7ea643a3-6c97-4bf2-ac2a-b53475d99d79 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.402395 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-60e6490f-85fd-428a-949e-1bafcb01cbc4 req-7ea643a3-6c97-4bf2-ac2a-b53475d99d79 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.433284 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-60e6490f-85fd-428a-949e-1bafcb01cbc4 req-7ea643a3-6c97-4bf2-ac2a-b53475d99d79 service nova] Creating event network-vif-plugged:00ec2991-6499-46ee-92c3-65a3dcb24629 for instance 6defc507-3456-460c-94f0-1d954af7997d on hv-cinder-73306 Jul 28 03:39:54.442438 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-60e6490f-85fd-428a-949e-1bafcb01cbc4 req-7ea643a3-6c97-4bf2-ac2a-b53475d99d79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078432 Jul 28 03:39:54.447087 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 247/485] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:54.458226 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-02168e7e-aa4a-454d-9b16-b07261185b9c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:54.458932 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-02168e7e-aa4a-454d-9b16-b07261185b9c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:54.473412 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-02168e7e-aa4a-454d-9b16-b07261185b9c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.474042 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-02168e7e-aa4a-454d-9b16-b07261185b9c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.474872 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-02168e7e-aa4a-454d-9b16-b07261185b9c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.475307 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-02168e7e-aa4a-454d-9b16-b07261185b9c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.674177 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-02168e7e-aa4a-454d-9b16-b07261185b9c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:54.688108 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-02168e7e-aa4a-454d-9b16-b07261185b9c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1501 microversion: 2.1 time: 0.233363 Jul 28 03:39:54.691082 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 248/486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:54 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:54.699291 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-bd75d759-be2a-4185-b80f-127abea3ff56 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:54.704446 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-bd75d759-be2a-4185-b80f-127abea3ff56 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:54.718343 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bd75d759-be2a-4185-b80f-127abea3ff56 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.722365 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-19f8a742-61e4-4892-865d-cc78c762cd57 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:54.727480 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bd75d759-be2a-4185-b80f-127abea3ff56 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.728358 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bd75d759-be2a-4185-b80f-127abea3ff56 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.728919 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bd75d759-be2a-4185-b80f-127abea3ff56 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.744103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-19f8a742-61e4-4892-865d-cc78c762cd57 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:54.750644 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-19f8a742-61e4-4892-865d-cc78c762cd57 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:54.753757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-19f8a742-61e4-4892-865d-cc78c762cd57 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.499136 Jul 28 03:39:54.755558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 239/487] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:54 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:54.765806 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fbde9993-62f3-4b62-894d-c51a8746af90 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:54.766956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fbde9993-62f3-4b62-894d-c51a8746af90 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:54.785661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fbde9993-62f3-4b62-894d-c51a8746af90 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.787908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fbde9993-62f3-4b62-894d-c51a8746af90 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.789893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fbde9993-62f3-4b62-894d-c51a8746af90 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:54.793837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fbde9993-62f3-4b62-894d-c51a8746af90 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:54.990727 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-bd75d759-be2a-4185-b80f-127abea3ff56 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:55.004312 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-bd75d759-be2a-4185-b80f-127abea3ff56 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.309450 Jul 28 03:39:55.009361 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 249/488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:54 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:55.037207 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-cb0de788-3354-4be5-82e8-dcdd2e63ecd1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:55.038309 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-cb0de788-3354-4be5-82e8-dcdd2e63ecd1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:55.047034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fbde9993-62f3-4b62-894d-c51a8746af90 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:55.054787 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cb0de788-3354-4be5-82e8-dcdd2e63ecd1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:55.060985 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cb0de788-3354-4be5-82e8-dcdd2e63ecd1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:55.063764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fbde9993-62f3-4b62-894d-c51a8746af90 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1514 microversion: 2.1 time: 0.306224 Jul 28 03:39:55.064984 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cb0de788-3354-4be5-82e8-dcdd2e63ecd1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:55.069935 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cb0de788-3354-4be5-82e8-dcdd2e63ecd1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:55.070882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 240/489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:54 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:55.327597 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-cb0de788-3354-4be5-82e8-dcdd2e63ecd1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:55.336575 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-cb0de788-3354-4be5-82e8-dcdd2e63ecd1 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.303236 Jul 28 03:39:55.349108 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 250/490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:55 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:55.362363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7e5eeaef-37c0-43a4-9bc4-30139760e621 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:55.363142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7e5eeaef-37c0-43a4-9bc4-30139760e621 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:55.374196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e5eeaef-37c0-43a4-9bc4-30139760e621 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:55.375277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e5eeaef-37c0-43a4-9bc4-30139760e621 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:55.376369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e5eeaef-37c0-43a4-9bc4-30139760e621 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:55.377586 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e5eeaef-37c0-43a4-9bc4-30139760e621 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:55.558010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7e5eeaef-37c0-43a4-9bc4-30139760e621 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:55.569792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7e5eeaef-37c0-43a4-9bc4-30139760e621 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.208767 Jul 28 03:39:55.571061 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 241/491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:55 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:55.775269 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f82da429-541c-4afc-869e-a7bdcc39bb5a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:55.776513 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f82da429-541c-4afc-869e-a7bdcc39bb5a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:55.793509 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f82da429-541c-4afc-869e-a7bdcc39bb5a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:55.794252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f82da429-541c-4afc-869e-a7bdcc39bb5a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:55.795045 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f82da429-541c-4afc-869e-a7bdcc39bb5a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:55.795479 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f82da429-541c-4afc-869e-a7bdcc39bb5a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:55.983507 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f82da429-541c-4afc-869e-a7bdcc39bb5a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:55.995252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f82da429-541c-4afc-869e-a7bdcc39bb5a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:55.998685 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f82da429-541c-4afc-869e-a7bdcc39bb5a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:56.000772 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f82da429-541c-4afc-869e-a7bdcc39bb5a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.229457 Jul 28 03:39:56.016244 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 251/492] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:55 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:56.028830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d197c2bd-5adc-4bb6-9c01-6a73e95fcc17 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:56.031405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d197c2bd-5adc-4bb6-9c01-6a73e95fcc17 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:56.041868 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d197c2bd-5adc-4bb6-9c01-6a73e95fcc17 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:56.046326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d197c2bd-5adc-4bb6-9c01-6a73e95fcc17 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:56.047487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d197c2bd-5adc-4bb6-9c01-6a73e95fcc17 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:56.048098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d197c2bd-5adc-4bb6-9c01-6a73e95fcc17 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:56.355871 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-459609f7-5200-4565-8237-013ac1b01456 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:56.356525 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-459609f7-5200-4565-8237-013ac1b01456 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:56.366649 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-459609f7-5200-4565-8237-013ac1b01456 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:56.371128 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-459609f7-5200-4565-8237-013ac1b01456 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:56.373007 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-459609f7-5200-4565-8237-013ac1b01456 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:56.377271 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-459609f7-5200-4565-8237-013ac1b01456 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:56.397721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d197c2bd-5adc-4bb6-9c01-6a73e95fcc17 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:56.406785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d197c2bd-5adc-4bb6-9c01-6a73e95fcc17 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.384179 Jul 28 03:39:56.417235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 242/493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:56 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:56.590493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1ff11b21-87b0-4d84-be3c-d363fa157beb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:56.591240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1ff11b21-87b0-4d84-be3c-d363fa157beb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:56.614809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ff11b21-87b0-4d84-be3c-d363fa157beb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:56.614809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ff11b21-87b0-4d84-be3c-d363fa157beb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:56.618635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ff11b21-87b0-4d84-be3c-d363fa157beb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:56.619174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ff11b21-87b0-4d84-be3c-d363fa157beb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:56.678342 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-459609f7-5200-4565-8237-013ac1b01456 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:56.705942 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-459609f7-5200-4565-8237-013ac1b01456 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.353633 Jul 28 03:39:56.707841 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 252/494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:56 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:56.726074 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8d61d2d3-6fd6-4b48-99e9-0f0f71f14903 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:56.727438 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8d61d2d3-6fd6-4b48-99e9-0f0f71f14903 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:56.751656 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8d61d2d3-6fd6-4b48-99e9-0f0f71f14903 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:56.758273 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8d61d2d3-6fd6-4b48-99e9-0f0f71f14903 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:56.759608 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8d61d2d3-6fd6-4b48-99e9-0f0f71f14903 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:56.761965 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8d61d2d3-6fd6-4b48-99e9-0f0f71f14903 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:56.842590 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.objects.instance [None req-8d61d2d3-6fd6-4b48-99e9-0f0f71f14903 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lazy-loading 'flavor' on Instance uuid a9eae018-81cf-4d77-8ac7-562c54a93e53 {{(pid=119155) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:39:56.887438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1ff11b21-87b0-4d84-be3c-d363fa157beb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:56.897946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1ff11b21-87b0-4d84-be3c-d363fa157beb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.311220 Jul 28 03:39:56.900832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 243/495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:56 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:57.024307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8d95d194-ff49-44b8-8b01-7a875a21d76b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:57.026321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8d95d194-ff49-44b8-8b01-7a875a21d76b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:57.035387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d95d194-ff49-44b8-8b01-7a875a21d76b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:57.039771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d95d194-ff49-44b8-8b01-7a875a21d76b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:57.042839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d95d194-ff49-44b8-8b01-7a875a21d76b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:57.043488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d95d194-ff49-44b8-8b01-7a875a21d76b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:57.087768 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8d61d2d3-6fd6-4b48-99e9-0f0f71f14903 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "POST /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53/action" status: 200 len: 32 microversion: 2.1 time: 0.365240 Jul 28 03:39:57.090170 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 253/496] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:39:56 2021] POST /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:39:57.104306 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e58ab843-9f91-46b3-b69d-98bdcf4192c6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:57.105142 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e58ab843-9f91-46b3-b69d-98bdcf4192c6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:57.120684 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e58ab843-9f91-46b3-b69d-98bdcf4192c6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:57.121199 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e58ab843-9f91-46b3-b69d-98bdcf4192c6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:57.125549 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e58ab843-9f91-46b3-b69d-98bdcf4192c6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:57.126865 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e58ab843-9f91-46b3-b69d-98bdcf4192c6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:57.257625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d95d194-ff49-44b8-8b01-7a875a21d76b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:57.271339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d95d194-ff49-44b8-8b01-7a875a21d76b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:57.273629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d95d194-ff49-44b8-8b01-7a875a21d76b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:57.274972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8d95d194-ff49-44b8-8b01-7a875a21d76b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.254724 Jul 28 03:39:57.289953 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 244/497] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:57 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:57.322290 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e58ab843-9f91-46b3-b69d-98bdcf4192c6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:57.331011 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e58ab843-9f91-46b3-b69d-98bdcf4192c6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.235119 Jul 28 03:39:57.332025 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 254/498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:57 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:57.424359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c409aa04-213f-468b-984d-18893499d9bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:57.424904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c409aa04-213f-468b-984d-18893499d9bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:57.432562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c409aa04-213f-468b-984d-18893499d9bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:57.434185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c409aa04-213f-468b-984d-18893499d9bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:57.436263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c409aa04-213f-468b-984d-18893499d9bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:57.436710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c409aa04-213f-468b-984d-18893499d9bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:57.662055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c409aa04-213f-468b-984d-18893499d9bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:57.671055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c409aa04-213f-468b-984d-18893499d9bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.250250 Jul 28 03:39:57.681010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 245/499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:57 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:57.726244 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a4d8f04d-6144-4711-a2c8-010a0cc672ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:57.726912 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a4d8f04d-6144-4711-a2c8-010a0cc672ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:57.741344 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a4d8f04d-6144-4711-a2c8-010a0cc672ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:57.741796 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a4d8f04d-6144-4711-a2c8-010a0cc672ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:57.742591 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a4d8f04d-6144-4711-a2c8-010a0cc672ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:57.743041 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a4d8f04d-6144-4711-a2c8-010a0cc672ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:57.914591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-77b48077-5186-4648-bdc6-744effa833bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:57.915192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-77b48077-5186-4648-bdc6-744effa833bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:57.925746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77b48077-5186-4648-bdc6-744effa833bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:57.926687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77b48077-5186-4648-bdc6-744effa833bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:57.927698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77b48077-5186-4648-bdc6-744effa833bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:57.928179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77b48077-5186-4648-bdc6-744effa833bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:57.929472 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a4d8f04d-6144-4711-a2c8-010a0cc672ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:57.942292 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a4d8f04d-6144-4711-a2c8-010a0cc672ab tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.219345 Jul 28 03:39:57.952197 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 255/500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:57 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:58.068677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-77b48077-5186-4648-bdc6-744effa833bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:58.076446 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-77b48077-5186-4648-bdc6-744effa833bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.165499 Jul 28 03:39:58.077492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 246/501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:57 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:58.294413 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-782110df-0e7d-4fb1-b9ba-f3e31e59cbd4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:58.295185 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-782110df-0e7d-4fb1-b9ba-f3e31e59cbd4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:58.301375 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-782110df-0e7d-4fb1-b9ba-f3e31e59cbd4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:58.301897 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-782110df-0e7d-4fb1-b9ba-f3e31e59cbd4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:58.302738 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-782110df-0e7d-4fb1-b9ba-f3e31e59cbd4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:58.303233 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-782110df-0e7d-4fb1-b9ba-f3e31e59cbd4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:58.348845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7c237c04-5b72-480e-9ca2-449cc4b321c9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:58.350302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7c237c04-5b72-480e-9ca2-449cc4b321c9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:58.357290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c237c04-5b72-480e-9ca2-449cc4b321c9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:58.358073 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c237c04-5b72-480e-9ca2-449cc4b321c9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:58.359072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c237c04-5b72-480e-9ca2-449cc4b321c9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:58.359750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c237c04-5b72-480e-9ca2-449cc4b321c9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:58.447631 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-782110df-0e7d-4fb1-b9ba-f3e31e59cbd4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:58.456721 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-782110df-0e7d-4fb1-b9ba-f3e31e59cbd4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:58.459104 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-782110df-0e7d-4fb1-b9ba-f3e31e59cbd4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:58.460288 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-782110df-0e7d-4fb1-b9ba-f3e31e59cbd4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.170251 Jul 28 03:39:58.468450 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 256/502] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:58 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:58.504464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7c237c04-5b72-480e-9ca2-449cc4b321c9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:58.511990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7c237c04-5b72-480e-9ca2-449cc4b321c9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.166902 Jul 28 03:39:58.512567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 247/503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:58 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:58.688492 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5f77d77b-ad89-46c1-879c-309d1c16d93d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:58.689479 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5f77d77b-ad89-46c1-879c-309d1c16d93d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:58.695615 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f77d77b-ad89-46c1-879c-309d1c16d93d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:58.696166 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f77d77b-ad89-46c1-879c-309d1c16d93d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:58.697008 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f77d77b-ad89-46c1-879c-309d1c16d93d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:58.698092 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5f77d77b-ad89-46c1-879c-309d1c16d93d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:58.849958 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5f77d77b-ad89-46c1-879c-309d1c16d93d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:58.860437 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5f77d77b-ad89-46c1-879c-309d1c16d93d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.174428 Jul 28 03:39:58.861287 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 257/504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:58 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:58.965540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f602cd33-5e69-421b-94b1-80598b133c5b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:58.966603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f602cd33-5e69-421b-94b1-80598b133c5b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:58.974218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f602cd33-5e69-421b-94b1-80598b133c5b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:58.975040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f602cd33-5e69-421b-94b1-80598b133c5b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:58.976076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f602cd33-5e69-421b-94b1-80598b133c5b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:58.976715 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f602cd33-5e69-421b-94b1-80598b133c5b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:59.095247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-eb3dc89e-acfe-4f13-b069-4c10b3a0d17f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:59.096406 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-eb3dc89e-acfe-4f13-b069-4c10b3a0d17f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:59.107221 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-eb3dc89e-acfe-4f13-b069-4c10b3a0d17f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:59.109268 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-eb3dc89e-acfe-4f13-b069-4c10b3a0d17f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:59.112865 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-eb3dc89e-acfe-4f13-b069-4c10b3a0d17f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:59.113619 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-eb3dc89e-acfe-4f13-b069-4c10b3a0d17f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:59.199789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f602cd33-5e69-421b-94b1-80598b133c5b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:59.211312 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f602cd33-5e69-421b-94b1-80598b133c5b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.249920 Jul 28 03:39:59.212599 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 248/505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:58 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:59.349880 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-eb3dc89e-acfe-4f13-b069-4c10b3a0d17f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:59.359321 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-eb3dc89e-acfe-4f13-b069-4c10b3a0d17f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.268006 Jul 28 03:39:59.360501 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 258/506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:59 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:59.480891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-96e8d55a-5b81-4cf7-b1e8-4a9242fc5fd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:59.481635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-96e8d55a-5b81-4cf7-b1e8-4a9242fc5fd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:59.487903 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96e8d55a-5b81-4cf7-b1e8-4a9242fc5fd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:59.488358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96e8d55a-5b81-4cf7-b1e8-4a9242fc5fd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:59.489136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96e8d55a-5b81-4cf7-b1e8-4a9242fc5fd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:59.489685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96e8d55a-5b81-4cf7-b1e8-4a9242fc5fd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:59.529558 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-beb007a0-c326-46da-81f0-20e587feb7ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:59.530661 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-beb007a0-c326-46da-81f0-20e587feb7ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:59.545856 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-beb007a0-c326-46da-81f0-20e587feb7ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:59.546703 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-beb007a0-c326-46da-81f0-20e587feb7ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:59.547740 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-beb007a0-c326-46da-81f0-20e587feb7ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:59.548393 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-beb007a0-c326-46da-81f0-20e587feb7ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:59.635560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-96e8d55a-5b81-4cf7-b1e8-4a9242fc5fd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:59.644658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-96e8d55a-5b81-4cf7-b1e8-4a9242fc5fd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:59.646143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-96e8d55a-5b81-4cf7-b1e8-4a9242fc5fd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:59.647419 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-96e8d55a-5b81-4cf7-b1e8-4a9242fc5fd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.171366 Jul 28 03:39:59.655824 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 249/507] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:39:59 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:59.696034 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-beb007a0-c326-46da-81f0-20e587feb7ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:59.704966 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-beb007a0-c326-46da-81f0-20e587feb7ec tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.179822 Jul 28 03:39:59.705732 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 259/508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:59 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:59.877771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b8579cf1-90ca-48cd-af34-57d7d409f521 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:59.878541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b8579cf1-90ca-48cd-af34-57d7d409f521 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:39:59.884800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b8579cf1-90ca-48cd-af34-57d7d409f521 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:59.885781 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b8579cf1-90ca-48cd-af34-57d7d409f521 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:39:59.886578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b8579cf1-90ca-48cd-af34-57d7d409f521 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:39:59.892201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b8579cf1-90ca-48cd-af34-57d7d409f521 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:00.058368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b8579cf1-90ca-48cd-af34-57d7d409f521 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:00.066697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b8579cf1-90ca-48cd-af34-57d7d409f521 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.192840 Jul 28 03:40:00.067474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 250/509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:39:59 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:00.230175 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-87f0efdf-41db-404b-b645-f3b45c5772e4 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:00.231658 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-87f0efdf-41db-404b-b645-f3b45c5772e4 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:00.238456 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-87f0efdf-41db-404b-b645-f3b45c5772e4 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:00.239292 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-87f0efdf-41db-404b-b645-f3b45c5772e4 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:00.240636 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-87f0efdf-41db-404b-b645-f3b45c5772e4 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:00.241199 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-87f0efdf-41db-404b-b645-f3b45c5772e4 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:00.264674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-bf2ff7e1-0179-49cc-844d-70c36372294f req-452fd04b-2b0f-4b7f-b1e4-8d5ea6992017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be21cb5-8869-41a2-9866-431b1d401f62", "name": "network-vif-unplugged", "status": "completed", "tag": "3dd4657d-306f-494f-8116-d5a46c725169"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:00.266321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:40:00.266321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:40:00.277618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-bf2ff7e1-0179-49cc-844d-70c36372294f req-452fd04b-2b0f-4b7f-b1e4-8d5ea6992017 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:00.280820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-bf2ff7e1-0179-49cc-844d-70c36372294f req-452fd04b-2b0f-4b7f-b1e4-8d5ea6992017 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:00.317064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-bf2ff7e1-0179-49cc-844d-70c36372294f req-452fd04b-2b0f-4b7f-b1e4-8d5ea6992017 service nova] Creating event network-vif-unplugged:3dd4657d-306f-494f-8116-d5a46c725169 for instance 7be21cb5-8869-41a2-9866-431b1d401f62 on hv-cinder-73306 Jul 28 03:40:00.334837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-bf2ff7e1-0179-49cc-844d-70c36372294f req-452fd04b-2b0f-4b7f-b1e4-8d5ea6992017 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074880 Jul 28 03:40:00.335912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 251/510] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:40:00 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:00.378045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c83a0895-1236-4bd2-b433-6cfa03f34148 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:00.378668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c83a0895-1236-4bd2-b433-6cfa03f34148 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:00.399165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c83a0895-1236-4bd2-b433-6cfa03f34148 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:00.399634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c83a0895-1236-4bd2-b433-6cfa03f34148 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:00.400493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c83a0895-1236-4bd2-b433-6cfa03f34148 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:00.400997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c83a0895-1236-4bd2-b433-6cfa03f34148 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:00.493826 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-87f0efdf-41db-404b-b645-f3b45c5772e4 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:00.504498 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-87f0efdf-41db-404b-b645-f3b45c5772e4 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.278088 Jul 28 03:40:00.513646 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 260/511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:00 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:00.606072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c83a0895-1236-4bd2-b433-6cfa03f34148 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:00.636243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c83a0895-1236-4bd2-b433-6cfa03f34148 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.260613 Jul 28 03:40:00.637028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 252/512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:00 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:00.719090 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-90cd2137-2573-4837-aa5e-593545199e96 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:00.719662 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-90cd2137-2573-4837-aa5e-593545199e96 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:00.725060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a4b2eb1b-478a-428b-96e6-6c328ca6fdaa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:00.725918 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a4b2eb1b-478a-428b-96e6-6c328ca6fdaa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:00.739543 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-90cd2137-2573-4837-aa5e-593545199e96 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:00.740016 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-90cd2137-2573-4837-aa5e-593545199e96 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:00.740827 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-90cd2137-2573-4837-aa5e-593545199e96 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:00.741259 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-90cd2137-2573-4837-aa5e-593545199e96 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:00.742051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4b2eb1b-478a-428b-96e6-6c328ca6fdaa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:00.742511 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4b2eb1b-478a-428b-96e6-6c328ca6fdaa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:00.743376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4b2eb1b-478a-428b-96e6-6c328ca6fdaa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:00.744070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4b2eb1b-478a-428b-96e6-6c328ca6fdaa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:01.023417 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-90cd2137-2573-4837-aa5e-593545199e96 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:01.033023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4b2eb1b-478a-428b-96e6-6c328ca6fdaa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:01.042373 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a4b2eb1b-478a-428b-96e6-6c328ca6fdaa tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.322951 Jul 28 03:40:01.043878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 253/513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:00 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:01.061373 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-90cd2137-2573-4837-aa5e-593545199e96 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:01.065242 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-90cd2137-2573-4837-aa5e-593545199e96 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:01.066464 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-90cd2137-2573-4837-aa5e-593545199e96 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.351507 Jul 28 03:40:01.067203 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 261/514] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:00 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:01.085831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-239916e8-8921-49f3-bb3b-6f77740c2293 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:01.086440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-239916e8-8921-49f3-bb3b-6f77740c2293 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:01.092896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-239916e8-8921-49f3-bb3b-6f77740c2293 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:01.093343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-239916e8-8921-49f3-bb3b-6f77740c2293 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:01.094110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-239916e8-8921-49f3-bb3b-6f77740c2293 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:01.094539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-239916e8-8921-49f3-bb3b-6f77740c2293 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:01.245870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-239916e8-8921-49f3-bb3b-6f77740c2293 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:01.265500 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-239916e8-8921-49f3-bb3b-6f77740c2293 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.183962 Jul 28 03:40:01.272594 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 254/515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:01 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:01.527216 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ad349445-19b3-486b-a09a-67df588dcee7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:01.527767 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ad349445-19b3-486b-a09a-67df588dcee7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:01.533797 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ad349445-19b3-486b-a09a-67df588dcee7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:01.534263 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ad349445-19b3-486b-a09a-67df588dcee7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:01.535020 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ad349445-19b3-486b-a09a-67df588dcee7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:01.535487 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ad349445-19b3-486b-a09a-67df588dcee7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:01.655774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-291d1f26-0e3b-48dc-abc1-ee7809afd530 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:01.656150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-291d1f26-0e3b-48dc-abc1-ee7809afd530 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:01.675960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-291d1f26-0e3b-48dc-abc1-ee7809afd530 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:01.676416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-291d1f26-0e3b-48dc-abc1-ee7809afd530 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:01.677212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-291d1f26-0e3b-48dc-abc1-ee7809afd530 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:01.677645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-291d1f26-0e3b-48dc-abc1-ee7809afd530 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:01.734557 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ad349445-19b3-486b-a09a-67df588dcee7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:01.742450 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ad349445-19b3-486b-a09a-67df588dcee7 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.219881 Jul 28 03:40:01.743079 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 262/516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:01 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:01.865387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-291d1f26-0e3b-48dc-abc1-ee7809afd530 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:01.873396 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-291d1f26-0e3b-48dc-abc1-ee7809afd530 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.222485 Jul 28 03:40:01.882892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 255/517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:01 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:02.060854 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-33e81601-d456-4981-904b-fa41d2492538 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:02.061471 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-33e81601-d456-4981-904b-fa41d2492538 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:02.067554 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-33e81601-d456-4981-904b-fa41d2492538 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:02.068035 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-33e81601-d456-4981-904b-fa41d2492538 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:02.068822 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-33e81601-d456-4981-904b-fa41d2492538 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:02.069412 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-33e81601-d456-4981-904b-fa41d2492538 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:02.085325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-48cc9c22-06b4-4bfe-86f8-7e024ee9e985 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:02.085940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-48cc9c22-06b4-4bfe-86f8-7e024ee9e985 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:02.098006 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-48cc9c22-06b4-4bfe-86f8-7e024ee9e985 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:02.098451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-48cc9c22-06b4-4bfe-86f8-7e024ee9e985 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:02.099265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-48cc9c22-06b4-4bfe-86f8-7e024ee9e985 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:02.099740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-48cc9c22-06b4-4bfe-86f8-7e024ee9e985 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:02.347136 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-33e81601-d456-4981-904b-fa41d2492538 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:02.385708 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-33e81601-d456-4981-904b-fa41d2492538 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.328874 Jul 28 03:40:02.389697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-48cc9c22-06b4-4bfe-86f8-7e024ee9e985 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:02.398271 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 263/518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:02 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:02.403725 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b10dbbba-9d15-47ef-9333-93af6f409409 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:02.404346 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b10dbbba-9d15-47ef-9333-93af6f409409 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:02.411194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-48cc9c22-06b4-4bfe-86f8-7e024ee9e985 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:02.413815 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-48cc9c22-06b4-4bfe-86f8-7e024ee9e985 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:02.415812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-48cc9c22-06b4-4bfe-86f8-7e024ee9e985 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.334410 Jul 28 03:40:02.427179 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b10dbbba-9d15-47ef-9333-93af6f409409 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:02.427179 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b10dbbba-9d15-47ef-9333-93af6f409409 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:02.427179 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b10dbbba-9d15-47ef-9333-93af6f409409 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:02.427179 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b10dbbba-9d15-47ef-9333-93af6f409409 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:02.429033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 256/519] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:02 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:02.642369 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b10dbbba-9d15-47ef-9333-93af6f409409 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:02.652961 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b10dbbba-9d15-47ef-9333-93af6f409409 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.253480 Jul 28 03:40:02.656984 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 264/520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:02 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:02.763003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8dada56e-846b-470b-8756-480355f68a19 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:02.763667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8dada56e-846b-470b-8756-480355f68a19 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:02.770197 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8dada56e-846b-470b-8756-480355f68a19 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:02.770676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8dada56e-846b-470b-8756-480355f68a19 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:02.771460 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8dada56e-846b-470b-8756-480355f68a19 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:02.774207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8dada56e-846b-470b-8756-480355f68a19 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:02.892642 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2e8e9dcd-6770-4276-8239-c219504290bc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:02.894247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2e8e9dcd-6770-4276-8239-c219504290bc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:02.909648 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2e8e9dcd-6770-4276-8239-c219504290bc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:02.910092 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2e8e9dcd-6770-4276-8239-c219504290bc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:02.910874 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2e8e9dcd-6770-4276-8239-c219504290bc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:02.911388 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2e8e9dcd-6770-4276-8239-c219504290bc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:02.996401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8dada56e-846b-470b-8756-480355f68a19 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:03.004034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8dada56e-846b-470b-8756-480355f68a19 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.248086 Jul 28 03:40:03.004803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 257/521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:02 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:03.099839 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-2e8e9dcd-6770-4276-8239-c219504290bc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:03.109101 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2e8e9dcd-6770-4276-8239-c219504290bc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.221804 Jul 28 03:40:03.110001 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 265/522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:02 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:03.406350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a22acb7a-830d-4e15-99c8-bb32d34a36e6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:03.407348 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a22acb7a-830d-4e15-99c8-bb32d34a36e6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:03.413662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a22acb7a-830d-4e15-99c8-bb32d34a36e6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:03.414837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a22acb7a-830d-4e15-99c8-bb32d34a36e6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:03.415362 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a22acb7a-830d-4e15-99c8-bb32d34a36e6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:03.415932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a22acb7a-830d-4e15-99c8-bb32d34a36e6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:03.435255 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f4e15ee5-c27c-48ac-b8b4-095a26d6dffc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:03.435976 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f4e15ee5-c27c-48ac-b8b4-095a26d6dffc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:03.442530 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f4e15ee5-c27c-48ac-b8b4-095a26d6dffc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:03.442984 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f4e15ee5-c27c-48ac-b8b4-095a26d6dffc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:03.443851 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f4e15ee5-c27c-48ac-b8b4-095a26d6dffc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:03.444311 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f4e15ee5-c27c-48ac-b8b4-095a26d6dffc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:03.573443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a22acb7a-830d-4e15-99c8-bb32d34a36e6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:03.590575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a22acb7a-830d-4e15-99c8-bb32d34a36e6 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.187802 Jul 28 03:40:03.591759 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 258/523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:03 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:03.610613 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f4e15ee5-c27c-48ac-b8b4-095a26d6dffc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:03.625429 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f4e15ee5-c27c-48ac-b8b4-095a26d6dffc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:03.626930 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f4e15ee5-c27c-48ac-b8b4-095a26d6dffc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:03.628124 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f4e15ee5-c27c-48ac-b8b4-095a26d6dffc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.197486 Jul 28 03:40:03.639169 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 266/524] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:03 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:40:03.671066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-222591aa-67bb-4105-acfa-cdae442521f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:03.671746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-222591aa-67bb-4105-acfa-cdae442521f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:03.678030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222591aa-67bb-4105-acfa-cdae442521f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:03.678563 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222591aa-67bb-4105-acfa-cdae442521f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:03.679289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222591aa-67bb-4105-acfa-cdae442521f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:03.679774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222591aa-67bb-4105-acfa-cdae442521f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:03.912373 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-222591aa-67bb-4105-acfa-cdae442521f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:03.932981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-222591aa-67bb-4105-acfa-cdae442521f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.266457 Jul 28 03:40:03.940476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 259/525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:03 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:04.023118 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d9083f3d-1793-485a-ac29-466b5ef7bfcb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:04.024757 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d9083f3d-1793-485a-ac29-466b5ef7bfcb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:04.033407 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9083f3d-1793-485a-ac29-466b5ef7bfcb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:04.034526 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9083f3d-1793-485a-ac29-466b5ef7bfcb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:04.035738 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9083f3d-1793-485a-ac29-466b5ef7bfcb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:04.036492 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9083f3d-1793-485a-ac29-466b5ef7bfcb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:04.129974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-852ee85b-690f-4b64-b5a2-df89642b70fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:04.131062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-852ee85b-690f-4b64-b5a2-df89642b70fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:04.147337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-852ee85b-690f-4b64-b5a2-df89642b70fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:04.147836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-852ee85b-690f-4b64-b5a2-df89642b70fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:04.148626 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-852ee85b-690f-4b64-b5a2-df89642b70fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:04.149066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-852ee85b-690f-4b64-b5a2-df89642b70fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:04.239354 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d9083f3d-1793-485a-ac29-466b5ef7bfcb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:04.248383 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d9083f3d-1793-485a-ac29-466b5ef7bfcb tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.230124 Jul 28 03:40:04.257642 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 267/526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:04 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:04.324048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-852ee85b-690f-4b64-b5a2-df89642b70fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:04.343189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-852ee85b-690f-4b64-b5a2-df89642b70fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.216451 Jul 28 03:40:04.353231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 260/527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:04 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:04.608256 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ef4492d1-21d0-4269-9678-0d644c906fa7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:04.608870 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ef4492d1-21d0-4269-9678-0d644c906fa7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:04.615025 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ef4492d1-21d0-4269-9678-0d644c906fa7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:04.615487 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ef4492d1-21d0-4269-9678-0d644c906fa7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:04.616252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ef4492d1-21d0-4269-9678-0d644c906fa7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:04.616683 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ef4492d1-21d0-4269-9678-0d644c906fa7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:04.647633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f218d73a-86c8-48cc-a190-6c18ebfea054 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:04.648787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f218d73a-86c8-48cc-a190-6c18ebfea054 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:04.656196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f218d73a-86c8-48cc-a190-6c18ebfea054 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:04.656955 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f218d73a-86c8-48cc-a190-6c18ebfea054 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:04.657740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f218d73a-86c8-48cc-a190-6c18ebfea054 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:04.658183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f218d73a-86c8-48cc-a190-6c18ebfea054 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:04.812587 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ef4492d1-21d0-4269-9678-0d644c906fa7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:04.823473 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ef4492d1-21d0-4269-9678-0d644c906fa7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.217429 Jul 28 03:40:04.824696 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 268/528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:04 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:04.842414 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f218d73a-86c8-48cc-a190-6c18ebfea054 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:04.851766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f218d73a-86c8-48cc-a190-6c18ebfea054 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:04.853248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f218d73a-86c8-48cc-a190-6c18ebfea054 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:04.854634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f218d73a-86c8-48cc-a190-6c18ebfea054 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.211338 Jul 28 03:40:04.855929 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 261/529] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:04 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:04.958800 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-24286838-200f-46b0-8ea9-e1cf3d396955 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:04.959472 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-24286838-200f-46b0-8ea9-e1cf3d396955 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:04.966743 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-24286838-200f-46b0-8ea9-e1cf3d396955 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:04.967211 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-24286838-200f-46b0-8ea9-e1cf3d396955 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:04.968017 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-24286838-200f-46b0-8ea9-e1cf3d396955 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:04.968449 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-24286838-200f-46b0-8ea9-e1cf3d396955 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:05.100211 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-24286838-200f-46b0-8ea9-e1cf3d396955 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:05.109294 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-24286838-200f-46b0-8ea9-e1cf3d396955 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.155346 Jul 28 03:40:05.110020 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 269/530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:04 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:05.310277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e06104ba-a458-4c40-af37-f4c3a9cc1e2d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:05.310277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e06104ba-a458-4c40-af37-f4c3a9cc1e2d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:05.380445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e06104ba-a458-4c40-af37-f4c3a9cc1e2d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:05.399817 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-23c7fa46-f6b7-4455-af77-653e096c3c33 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:05.399817 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-23c7fa46-f6b7-4455-af77-653e096c3c33 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:05.400151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e06104ba-a458-4c40-af37-f4c3a9cc1e2d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:05.400151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e06104ba-a458-4c40-af37-f4c3a9cc1e2d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:05.400151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e06104ba-a458-4c40-af37-f4c3a9cc1e2d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:05.406237 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-23c7fa46-f6b7-4455-af77-653e096c3c33 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:05.406683 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-23c7fa46-f6b7-4455-af77-653e096c3c33 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:05.407494 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-23c7fa46-f6b7-4455-af77-653e096c3c33 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:05.410418 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-23c7fa46-f6b7-4455-af77-653e096c3c33 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:05.655542 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-23c7fa46-f6b7-4455-af77-653e096c3c33 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:05.666615 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-23c7fa46-f6b7-4455-af77-653e096c3c33 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.295477 Jul 28 03:40:05.668664 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 270/531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:05 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:05.672822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e06104ba-a458-4c40-af37-f4c3a9cc1e2d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:05.680879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e06104ba-a458-4c40-af37-f4c3a9cc1e2d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.383243 Jul 28 03:40:05.691277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 262/532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:05 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:05.841010 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1d4ebf29-92c9-44fe-b793-f16f45d74297 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:05.841753 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1d4ebf29-92c9-44fe-b793-f16f45d74297 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:05.850676 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1d4ebf29-92c9-44fe-b793-f16f45d74297 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:05.851225 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1d4ebf29-92c9-44fe-b793-f16f45d74297 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:05.852568 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1d4ebf29-92c9-44fe-b793-f16f45d74297 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:05.853252 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1d4ebf29-92c9-44fe-b793-f16f45d74297 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:05.873628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5675081e-6bcd-4e13-8c4e-0fc519e3ec46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:05.874244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5675081e-6bcd-4e13-8c4e-0fc519e3ec46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:05.887740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5675081e-6bcd-4e13-8c4e-0fc519e3ec46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:05.887740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5675081e-6bcd-4e13-8c4e-0fc519e3ec46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:05.887740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5675081e-6bcd-4e13-8c4e-0fc519e3ec46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:05.887740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5675081e-6bcd-4e13-8c4e-0fc519e3ec46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:06.020895 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1d4ebf29-92c9-44fe-b793-f16f45d74297 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:06.030078 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1d4ebf29-92c9-44fe-b793-f16f45d74297 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.193037 Jul 28 03:40:06.031303 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 271/533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:05 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:06.056356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5675081e-6bcd-4e13-8c4e-0fc519e3ec46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:06.065427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5675081e-6bcd-4e13-8c4e-0fc519e3ec46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:06.067349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5675081e-6bcd-4e13-8c4e-0fc519e3ec46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:06.068595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5675081e-6bcd-4e13-8c4e-0fc519e3ec46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.199621 Jul 28 03:40:06.069217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 263/534] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:05 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:40:06.130282 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-6c9adeb2-4731-4dee-b942-2cae763e6c3c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:06.131359 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-6c9adeb2-4731-4dee-b942-2cae763e6c3c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:06.140909 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6c9adeb2-4731-4dee-b942-2cae763e6c3c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:06.141537 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6c9adeb2-4731-4dee-b942-2cae763e6c3c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:06.143886 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6c9adeb2-4731-4dee-b942-2cae763e6c3c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:06.145065 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6c9adeb2-4731-4dee-b942-2cae763e6c3c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:06.298621 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-6c9adeb2-4731-4dee-b942-2cae763e6c3c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:06.307311 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-6c9adeb2-4731-4dee-b942-2cae763e6c3c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.180586 Jul 28 03:40:06.308595 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 272/535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:06 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:06.688075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-54028809-2260-49da-ac5d-dde3bc11c604 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:06.688863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-54028809-2260-49da-ac5d-dde3bc11c604 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:06.702345 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d2f82b3b-c141-43ef-b83b-6d3864723471 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:06.703067 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d2f82b3b-c141-43ef-b83b-6d3864723471 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:06.717139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54028809-2260-49da-ac5d-dde3bc11c604 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:06.717869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d2f82b3b-c141-43ef-b83b-6d3864723471 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:06.718479 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d2f82b3b-c141-43ef-b83b-6d3864723471 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:06.718884 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54028809-2260-49da-ac5d-dde3bc11c604 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:06.721409 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d2f82b3b-c141-43ef-b83b-6d3864723471 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:06.722019 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d2f82b3b-c141-43ef-b83b-6d3864723471 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:06.722270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54028809-2260-49da-ac5d-dde3bc11c604 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:06.722885 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54028809-2260-49da-ac5d-dde3bc11c604 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:06.872830 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d2f82b3b-c141-43ef-b83b-6d3864723471 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:06.874601 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-54028809-2260-49da-ac5d-dde3bc11c604 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:06.881254 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d2f82b3b-c141-43ef-b83b-6d3864723471 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.186481 Jul 28 03:40:06.882524 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 273/536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:06 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:06.892907 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-54028809-2260-49da-ac5d-dde3bc11c604 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.198463 Jul 28 03:40:06.903147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 264/537] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:06 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:07.047782 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-9cb875ed-932e-4eec-a136-a2139bad4c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:07.048392 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-9cb875ed-932e-4eec-a136-a2139bad4c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:07.054333 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9cb875ed-932e-4eec-a136-a2139bad4c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:07.054775 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9cb875ed-932e-4eec-a136-a2139bad4c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:07.055548 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9cb875ed-932e-4eec-a136-a2139bad4c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:07.056003 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9cb875ed-932e-4eec-a136-a2139bad4c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:07.093328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f90ef747-62ea-4b30-ac11-da25c32e9d95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:07.093931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f90ef747-62ea-4b30-ac11-da25c32e9d95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:07.100065 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f90ef747-62ea-4b30-ac11-da25c32e9d95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:07.100592 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f90ef747-62ea-4b30-ac11-da25c32e9d95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:07.101389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f90ef747-62ea-4b30-ac11-da25c32e9d95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:07.101818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f90ef747-62ea-4b30-ac11-da25c32e9d95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:07.178699 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-9cb875ed-932e-4eec-a136-a2139bad4c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:07.186060 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-9cb875ed-932e-4eec-a136-a2139bad4c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.141920 Jul 28 03:40:07.186618 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 274/538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:07 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:07.224752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f90ef747-62ea-4b30-ac11-da25c32e9d95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:07.234141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f90ef747-62ea-4b30-ac11-da25c32e9d95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:07.235642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f90ef747-62ea-4b30-ac11-da25c32e9d95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:07.236842 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f90ef747-62ea-4b30-ac11-da25c32e9d95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.147113 Jul 28 03:40:07.237396 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 265/539] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:07 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:40:07.327039 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-243baf87-2c86-4d91-896c-815beed47c13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:07.327641 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-243baf87-2c86-4d91-896c-815beed47c13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:07.333506 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-243baf87-2c86-4d91-896c-815beed47c13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:07.333946 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-243baf87-2c86-4d91-896c-815beed47c13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:07.334704 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-243baf87-2c86-4d91-896c-815beed47c13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:07.335137 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-243baf87-2c86-4d91-896c-815beed47c13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:07.458245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-243baf87-2c86-4d91-896c-815beed47c13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:07.468278 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-243baf87-2c86-4d91-896c-815beed47c13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.145596 Jul 28 03:40:07.480177 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 275/540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:07 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:07.899832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-87e43458-1b11-4d5a-a86e-73485729a821 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:07.900433 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-87e43458-1b11-4d5a-a86e-73485729a821 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:07.906472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87e43458-1b11-4d5a-a86e-73485729a821 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:07.906926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87e43458-1b11-4d5a-a86e-73485729a821 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:07.907750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87e43458-1b11-4d5a-a86e-73485729a821 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:07.908193 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87e43458-1b11-4d5a-a86e-73485729a821 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:07.910775 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-45290977-f86e-43a0-b991-fbddecec6c1c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:07.911379 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-45290977-f86e-43a0-b991-fbddecec6c1c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:07.918362 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45290977-f86e-43a0-b991-fbddecec6c1c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:07.918905 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45290977-f86e-43a0-b991-fbddecec6c1c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:07.919675 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45290977-f86e-43a0-b991-fbddecec6c1c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:07.920130 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45290977-f86e-43a0-b991-fbddecec6c1c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:08.040755 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-87e43458-1b11-4d5a-a86e-73485729a821 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:08.050046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-87e43458-1b11-4d5a-a86e-73485729a821 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.153842 Jul 28 03:40:08.050914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 266/541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:07 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:08.063684 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-45290977-f86e-43a0-b991-fbddecec6c1c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:08.071441 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-45290977-f86e-43a0-b991-fbddecec6c1c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.164249 Jul 28 03:40:08.072021 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 276/542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:07 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:08.201989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b18935a5-fff8-4006-b3ec-5fb9eded8c0e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:08.202692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b18935a5-fff8-4006-b3ec-5fb9eded8c0e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:08.208494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b18935a5-fff8-4006-b3ec-5fb9eded8c0e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:08.209038 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b18935a5-fff8-4006-b3ec-5fb9eded8c0e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:08.209882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b18935a5-fff8-4006-b3ec-5fb9eded8c0e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:08.210418 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b18935a5-fff8-4006-b3ec-5fb9eded8c0e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:08.256792 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1c89f72d-bb26-4552-9e18-fbb1f184f7d5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:08.257397 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1c89f72d-bb26-4552-9e18-fbb1f184f7d5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:08.263842 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1c89f72d-bb26-4552-9e18-fbb1f184f7d5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:08.264361 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1c89f72d-bb26-4552-9e18-fbb1f184f7d5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:08.265087 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1c89f72d-bb26-4552-9e18-fbb1f184f7d5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:08.265694 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1c89f72d-bb26-4552-9e18-fbb1f184f7d5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:08.349036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b18935a5-fff8-4006-b3ec-5fb9eded8c0e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:08.357281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b18935a5-fff8-4006-b3ec-5fb9eded8c0e tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.158949 Jul 28 03:40:08.357846 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 267/543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:08 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:08.403392 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1c89f72d-bb26-4552-9e18-fbb1f184f7d5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:08.412189 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1c89f72d-bb26-4552-9e18-fbb1f184f7d5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:08.413694 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1c89f72d-bb26-4552-9e18-fbb1f184f7d5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:08.414828 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1c89f72d-bb26-4552-9e18-fbb1f184f7d5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.161703 Jul 28 03:40:08.415376 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 277/544] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:08 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:40:08.486590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-24880a54-bac9-49c6-8a36-8bb96fa3f3ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:08.487311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-24880a54-bac9-49c6-8a36-8bb96fa3f3ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:08.493466 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24880a54-bac9-49c6-8a36-8bb96fa3f3ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:08.493749 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24880a54-bac9-49c6-8a36-8bb96fa3f3ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:08.494561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24880a54-bac9-49c6-8a36-8bb96fa3f3ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:08.495020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24880a54-bac9-49c6-8a36-8bb96fa3f3ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:08.626922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-24880a54-bac9-49c6-8a36-8bb96fa3f3ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:08.634143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-24880a54-bac9-49c6-8a36-8bb96fa3f3ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.151724 Jul 28 03:40:08.635186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 268/545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:08 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:09.067245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ea052847-3374-4d63-95c5-10268da16622 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:09.067911 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ea052847-3374-4d63-95c5-10268da16622 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:09.074467 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ea052847-3374-4d63-95c5-10268da16622 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.074915 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ea052847-3374-4d63-95c5-10268da16622 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.075684 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ea052847-3374-4d63-95c5-10268da16622 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.076157 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ea052847-3374-4d63-95c5-10268da16622 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.087750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4b27e5ff-1282-4d75-890c-c8ca633416ec tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:09.088382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4b27e5ff-1282-4d75-890c-c8ca633416ec tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:09.094068 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b27e5ff-1282-4d75-890c-c8ca633416ec tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.094526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b27e5ff-1282-4d75-890c-c8ca633416ec tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.096045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b27e5ff-1282-4d75-890c-c8ca633416ec tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.096493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b27e5ff-1282-4d75-890c-c8ca633416ec tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.210343 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ea052847-3374-4d63-95c5-10268da16622 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:09.218083 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ea052847-3374-4d63-95c5-10268da16622 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1512 microversion: 2.1 time: 0.154437 Jul 28 03:40:09.228501 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 278/546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:09 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:09.278613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4b27e5ff-1282-4d75-890c-c8ca633416ec tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:09.287099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4b27e5ff-1282-4d75-890c-c8ca633416ec tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.202992 Jul 28 03:40:09.288028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 269/547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:09 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:09.374736 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-07ff9aa6-fd84-4800-89c5-29e312f0e8b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:09.375343 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-07ff9aa6-fd84-4800-89c5-29e312f0e8b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:09.382867 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-07ff9aa6-fd84-4800-89c5-29e312f0e8b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.383461 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-07ff9aa6-fd84-4800-89c5-29e312f0e8b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.384498 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-07ff9aa6-fd84-4800-89c5-29e312f0e8b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.385270 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-07ff9aa6-fd84-4800-89c5-29e312f0e8b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.437232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-46312a6e-d7e0-45fb-bdcf-f7b797e7f809 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:09.438222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-46312a6e-d7e0-45fb-bdcf-f7b797e7f809 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:09.444573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46312a6e-d7e0-45fb-bdcf-f7b797e7f809 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.445677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46312a6e-d7e0-45fb-bdcf-f7b797e7f809 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.446678 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46312a6e-d7e0-45fb-bdcf-f7b797e7f809 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.447486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46312a6e-d7e0-45fb-bdcf-f7b797e7f809 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.667623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-46312a6e-d7e0-45fb-bdcf-f7b797e7f809 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:09.676560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-46312a6e-d7e0-45fb-bdcf-f7b797e7f809 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:09.679048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-46312a6e-d7e0-45fb-bdcf-f7b797e7f809 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:09.679908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-46312a6e-d7e0-45fb-bdcf-f7b797e7f809 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.250331 Jul 28 03:40:09.680567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 270/548] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:09 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:40:09.696756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5aeef386-1622-4a1c-a70b-cc5c2a8d45b6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:09.697747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5aeef386-1622-4a1c-a70b-cc5c2a8d45b6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:09.703573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5aeef386-1622-4a1c-a70b-cc5c2a8d45b6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.704059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5aeef386-1622-4a1c-a70b-cc5c2a8d45b6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.705209 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5aeef386-1622-4a1c-a70b-cc5c2a8d45b6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.705800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5aeef386-1622-4a1c-a70b-cc5c2a8d45b6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.807253 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-07ff9aa6-fd84-4800-89c5-29e312f0e8b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:09.821723 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-07ff9aa6-fd84-4800-89c5-29e312f0e8b8 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.450477 Jul 28 03:40:09.826693 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 279/549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:09 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:09.905524 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-9580056c-6e4e-4468-b613-ef660e3b3b61 req-f1c0a478-d695-4c57-9a71-fabf71bfe82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be21cb5-8869-41a2-9866-431b1d401f62", "name": "network-vif-deleted", "tag": "3dd4657d-306f-494f-8116-d5a46c725169"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:09.907642 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:40:09.907642 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:40:09.917343 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-9580056c-6e4e-4468-b613-ef660e3b3b61 req-f1c0a478-d695-4c57-9a71-fabf71bfe82c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:09.918468 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-9580056c-6e4e-4468-b613-ef660e3b3b61 req-f1c0a478-d695-4c57-9a71-fabf71bfe82c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:09.930499 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-9580056c-6e4e-4468-b613-ef660e3b3b61 req-f1c0a478-d695-4c57-9a71-fabf71bfe82c service nova] Creating event network-vif-deleted:3dd4657d-306f-494f-8116-d5a46c725169 for instance 7be21cb5-8869-41a2-9866-431b1d401f62 on hv-cinder-73306 Jul 28 03:40:09.936584 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-9580056c-6e4e-4468-b613-ef660e3b3b61 req-f1c0a478-d695-4c57-9a71-fabf71bfe82c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034112 Jul 28 03:40:09.937932 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 280/550] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:40:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:10.014505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5aeef386-1622-4a1c-a70b-cc5c2a8d45b6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:10.021693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5aeef386-1622-4a1c-a70b-cc5c2a8d45b6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.328468 Jul 28 03:40:10.022269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 271/551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:09 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:10.235665 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:10.236322 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:10.242297 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:10.243173 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:10.243451 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:10.243937 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:10.274977 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:10.276121 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:10.276570 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.objects.instance [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lazy-loading 'fault' on Instance uuid 7be21cb5-8869-41a2-9866-431b1d401f62 {{(pid=119155) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:40:10.304050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1cf016df-2c05-4eb3-86b0-5e630961c190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:10.305339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1cf016df-2c05-4eb3-86b0-5e630961c190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:10.313524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1cf016df-2c05-4eb3-86b0-5e630961c190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:10.316247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1cf016df-2c05-4eb3-86b0-5e630961c190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:10.320494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1cf016df-2c05-4eb3-86b0-5e630961c190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:10.324284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1cf016df-2c05-4eb3-86b0-5e630961c190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:10.351104 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:10.364313 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-7ffb5f25-d021-4d65-81fc-5b0fcfe37db3 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 200 len: 1307 microversion: 2.1 time: 0.132771 Jul 28 03:40:10.365063 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 281/552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:10 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 1307 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:10.483539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1cf016df-2c05-4eb3-86b0-5e630961c190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:10.490914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1cf016df-2c05-4eb3-86b0-5e630961c190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1319 microversion: 2.1 time: 0.190900 Jul 28 03:40:10.491476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 272/553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:10 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:10.698762 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5a028a8e-e5d8-4c22-81b6-2940260ecfe9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:10.699979 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5a028a8e-e5d8-4c22-81b6-2940260ecfe9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:10.705840 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5a028a8e-e5d8-4c22-81b6-2940260ecfe9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:10.706422 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5a028a8e-e5d8-4c22-81b6-2940260ecfe9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:10.707319 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5a028a8e-e5d8-4c22-81b6-2940260ecfe9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:10.707897 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5a028a8e-e5d8-4c22-81b6-2940260ecfe9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:10.836057 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5a028a8e-e5d8-4c22-81b6-2940260ecfe9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:10.841630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1632c459-f2da-4792-9a18-3e7cc8a6e22a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:10.842060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1632c459-f2da-4792-9a18-3e7cc8a6e22a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:10.845943 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5a028a8e-e5d8-4c22-81b6-2940260ecfe9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:10.847503 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5a028a8e-e5d8-4c22-81b6-2940260ecfe9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:10.848398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1632c459-f2da-4792-9a18-3e7cc8a6e22a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:10.848735 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5a028a8e-e5d8-4c22-81b6-2940260ecfe9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.154283 Jul 28 03:40:10.848863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1632c459-f2da-4792-9a18-3e7cc8a6e22a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:10.849307 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 282/554] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:10 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:10.849640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1632c459-f2da-4792-9a18-3e7cc8a6e22a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:10.850084 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1632c459-f2da-4792-9a18-3e7cc8a6e22a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:10.987614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1632c459-f2da-4792-9a18-3e7cc8a6e22a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:11.000869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1632c459-f2da-4792-9a18-3e7cc8a6e22a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.162889 Jul 28 03:40:11.011118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 273/555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:10 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:11.039331 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-695ed5c7-725a-4f32-9252-9a4a8204dcbe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:11.039971 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-695ed5c7-725a-4f32-9252-9a4a8204dcbe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:11.046751 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-695ed5c7-725a-4f32-9252-9a4a8204dcbe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:11.047206 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-695ed5c7-725a-4f32-9252-9a4a8204dcbe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:11.048338 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-695ed5c7-725a-4f32-9252-9a4a8204dcbe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:11.048483 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-695ed5c7-725a-4f32-9252-9a4a8204dcbe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:11.171122 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-695ed5c7-725a-4f32-9252-9a4a8204dcbe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:11.178361 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-695ed5c7-725a-4f32-9252-9a4a8204dcbe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.142771 Jul 28 03:40:11.178895 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 283/556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:11 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:11.381151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2f8816d2-186f-4cd4-899c-1fe92665b9c0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:11.381758 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2f8816d2-186f-4cd4-899c-1fe92665b9c0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: 7be21cb5-8869-41a2-9866-431b1d401f62] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:11.388140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f8816d2-186f-4cd4-899c-1fe92665b9c0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:11.388595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f8816d2-186f-4cd4-899c-1fe92665b9c0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:11.389352 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f8816d2-186f-4cd4-899c-1fe92665b9c0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:11.389780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f8816d2-186f-4cd4-899c-1fe92665b9c0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:11.403385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-2f8816d2-186f-4cd4-899c-1fe92665b9c0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] HTTP exception thrown: Instance 7be21cb5-8869-41a2-9866-431b1d401f62 could not be found. Jul 28 03:40:11.403979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2f8816d2-186f-4cd4-899c-1fe92665b9c0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Returning 404 to user: Instance 7be21cb5-8869-41a2-9866-431b1d401f62 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:40:11.404775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2f8816d2-186f-4cd4-899c-1fe92665b9c0 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62" status: 404 len: 111 microversion: 2.1 time: 0.027275 Jul 28 03:40:11.405276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 274/557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:11 2021] GET /compute/v2.1/servers/7be21cb5-8869-41a2-9866-431b1d401f62 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:11.508604 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-52db0aa2-3d4e-4bfc-b4e8-9f55941c111b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:11.509395 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-52db0aa2-3d4e-4bfc-b4e8-9f55941c111b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:11.516600 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-52db0aa2-3d4e-4bfc-b4e8-9f55941c111b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:11.517186 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-52db0aa2-3d4e-4bfc-b4e8-9f55941c111b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:11.518046 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-52db0aa2-3d4e-4bfc-b4e8-9f55941c111b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:11.518576 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-52db0aa2-3d4e-4bfc-b4e8-9f55941c111b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:11.642541 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-52db0aa2-3d4e-4bfc-b4e8-9f55941c111b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:11.649656 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-52db0aa2-3d4e-4bfc-b4e8-9f55941c111b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1508 microversion: 2.1 time: 0.145249 Jul 28 03:40:11.650237 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 284/558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:11 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:11.868058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2f1b605b-ff5b-4ddb-b6ad-fda667369542 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:11.868670 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2f1b605b-ff5b-4ddb-b6ad-fda667369542 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:11.874706 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f1b605b-ff5b-4ddb-b6ad-fda667369542 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:11.875155 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f1b605b-ff5b-4ddb-b6ad-fda667369542 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:11.875967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f1b605b-ff5b-4ddb-b6ad-fda667369542 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:11.876403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f1b605b-ff5b-4ddb-b6ad-fda667369542 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:12.004299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2f1b605b-ff5b-4ddb-b6ad-fda667369542 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:12.013946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2f1b605b-ff5b-4ddb-b6ad-fda667369542 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:12.015429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2f1b605b-ff5b-4ddb-b6ad-fda667369542 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:12.016607 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2f1b605b-ff5b-4ddb-b6ad-fda667369542 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.152166 Jul 28 03:40:12.017145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 275/559] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:11 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:12.031467 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ff0dec07-4ea7-4234-a5f1-f3e7ef80a2e7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:12.032110 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ff0dec07-4ea7-4234-a5f1-f3e7ef80a2e7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:12.038488 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff0dec07-4ea7-4234-a5f1-f3e7ef80a2e7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:12.038942 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff0dec07-4ea7-4234-a5f1-f3e7ef80a2e7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:12.039772 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff0dec07-4ea7-4234-a5f1-f3e7ef80a2e7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:12.040394 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ff0dec07-4ea7-4234-a5f1-f3e7ef80a2e7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:12.171321 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ff0dec07-4ea7-4234-a5f1-f3e7ef80a2e7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:12.178559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ff0dec07-4ea7-4234-a5f1-f3e7ef80a2e7 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.161885 Jul 28 03:40:12.179123 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 285/560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:12 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:12.195125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-90373861-fdbc-4ad9-812f-d074ca138ff3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:12.195688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-90373861-fdbc-4ad9-812f-d074ca138ff3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:12.202321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90373861-fdbc-4ad9-812f-d074ca138ff3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:12.202782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90373861-fdbc-4ad9-812f-d074ca138ff3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:12.203560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90373861-fdbc-4ad9-812f-d074ca138ff3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:12.204028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-90373861-fdbc-4ad9-812f-d074ca138ff3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:12.331541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-90373861-fdbc-4ad9-812f-d074ca138ff3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:12.339852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-90373861-fdbc-4ad9-812f-d074ca138ff3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.148589 Jul 28 03:40:12.340543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 276/561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:12 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:12.536108 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-af4974a5-1fd6-4210-9d5e-da52354592fe tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:12.536637 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-af4974a5-1fd6-4210-9d5e-da52354592fe tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:12.542446 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-af4974a5-1fd6-4210-9d5e-da52354592fe tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:12.542901 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-af4974a5-1fd6-4210-9d5e-da52354592fe tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:12.543769 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-af4974a5-1fd6-4210-9d5e-da52354592fe tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:12.544257 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-af4974a5-1fd6-4210-9d5e-da52354592fe tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:12.576645 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-af4974a5-1fd6-4210-9d5e-da52354592fe tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Going to try to terminate instance {{(pid=119155) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:40:12.658116 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-af4974a5-1fd6-4210-9d5e-da52354592fe tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 204 len: 0 microversion: 2.1 time: 0.125311 Jul 28 03:40:12.658727 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 286/562] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:40:12 2021] DELETE /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:40:12.666645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c00f456e-71e7-4b0e-a0dd-6b2d9d9d76f5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:12.667832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c00f456e-71e7-4b0e-a0dd-6b2d9d9d76f5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:12.673910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c00f456e-71e7-4b0e-a0dd-6b2d9d9d76f5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:12.674486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c00f456e-71e7-4b0e-a0dd-6b2d9d9d76f5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:12.675425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c00f456e-71e7-4b0e-a0dd-6b2d9d9d76f5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:12.675891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c00f456e-71e7-4b0e-a0dd-6b2d9d9d76f5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:12.804067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c00f456e-71e7-4b0e-a0dd-6b2d9d9d76f5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:12.811850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c00f456e-71e7-4b0e-a0dd-6b2d9d9d76f5 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1512 microversion: 2.1 time: 0.149051 Jul 28 03:40:12.812404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 277/563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:12 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:13.035187 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ccee3f70-e611-4b36-86d7-579c9f70a6f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:13.035807 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ccee3f70-e611-4b36-86d7-579c9f70a6f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:13.042176 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ccee3f70-e611-4b36-86d7-579c9f70a6f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:13.042619 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ccee3f70-e611-4b36-86d7-579c9f70a6f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:13.043382 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ccee3f70-e611-4b36-86d7-579c9f70a6f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:13.043830 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ccee3f70-e611-4b36-86d7-579c9f70a6f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:13.166575 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ccee3f70-e611-4b36-86d7-579c9f70a6f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:13.175040 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ccee3f70-e611-4b36-86d7-579c9f70a6f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:13.176663 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ccee3f70-e611-4b36-86d7-579c9f70a6f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:13.177872 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ccee3f70-e611-4b36-86d7-579c9f70a6f5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.147077 Jul 28 03:40:13.178499 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 287/564] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:13 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:13.196358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c13d6fcb-5abd-452d-8d85-ddbe416a5f23 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:13.196997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c13d6fcb-5abd-452d-8d85-ddbe416a5f23 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:13.204022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c13d6fcb-5abd-452d-8d85-ddbe416a5f23 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:13.204474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c13d6fcb-5abd-452d-8d85-ddbe416a5f23 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:13.205267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c13d6fcb-5abd-452d-8d85-ddbe416a5f23 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:13.205707 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c13d6fcb-5abd-452d-8d85-ddbe416a5f23 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:13.324282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c13d6fcb-5abd-452d-8d85-ddbe416a5f23 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:13.331394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c13d6fcb-5abd-452d-8d85-ddbe416a5f23 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.138671 Jul 28 03:40:13.331989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 278/565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:13 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:13.357647 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f60192fd-1c0b-444d-a6bc-8260fd8f3fb7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:13.358250 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f60192fd-1c0b-444d-a6bc-8260fd8f3fb7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:13.364016 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f60192fd-1c0b-444d-a6bc-8260fd8f3fb7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:13.364466 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f60192fd-1c0b-444d-a6bc-8260fd8f3fb7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:13.365215 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f60192fd-1c0b-444d-a6bc-8260fd8f3fb7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:13.365653 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f60192fd-1c0b-444d-a6bc-8260fd8f3fb7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:13.491811 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f60192fd-1c0b-444d-a6bc-8260fd8f3fb7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:13.499038 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f60192fd-1c0b-444d-a6bc-8260fd8f3fb7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.145635 Jul 28 03:40:13.499587 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 288/566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:13 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:13.829114 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-aed53f9a-890d-4c36-bca7-0054744e736b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:13.829723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-aed53f9a-890d-4c36-bca7-0054744e736b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:13.835504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aed53f9a-890d-4c36-bca7-0054744e736b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:13.835992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aed53f9a-890d-4c36-bca7-0054744e736b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:13.836761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aed53f9a-890d-4c36-bca7-0054744e736b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:13.837195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aed53f9a-890d-4c36-bca7-0054744e736b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:13.968880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-aed53f9a-890d-4c36-bca7-0054744e736b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:13.976393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-aed53f9a-890d-4c36-bca7-0054744e736b tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1512 microversion: 2.1 time: 0.150921 Jul 28 03:40:13.976957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 279/567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:13 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:14.195606 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-590eb9f6-54fe-4c67-b043-b5454512231d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:14.196239 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-590eb9f6-54fe-4c67-b043-b5454512231d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:14.202695 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-590eb9f6-54fe-4c67-b043-b5454512231d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:14.203139 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-590eb9f6-54fe-4c67-b043-b5454512231d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:14.203929 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-590eb9f6-54fe-4c67-b043-b5454512231d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:14.204361 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-590eb9f6-54fe-4c67-b043-b5454512231d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:14.327398 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-590eb9f6-54fe-4c67-b043-b5454512231d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:14.335477 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-590eb9f6-54fe-4c67-b043-b5454512231d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:14.337048 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-590eb9f6-54fe-4c67-b043-b5454512231d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:14.338638 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-590eb9f6-54fe-4c67-b043-b5454512231d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.146687 Jul 28 03:40:14.339375 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 289/568] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:14 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:14.348196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b87c25ad-e78e-43ee-90b6-b59a93a50ae4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:14.349085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b87c25ad-e78e-43ee-90b6-b59a93a50ae4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:14.355526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b87c25ad-e78e-43ee-90b6-b59a93a50ae4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:14.356117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b87c25ad-e78e-43ee-90b6-b59a93a50ae4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:14.356896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b87c25ad-e78e-43ee-90b6-b59a93a50ae4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:14.357341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b87c25ad-e78e-43ee-90b6-b59a93a50ae4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:14.381043 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-7eda89b7-b4a8-48c9-8c76-f42240c2fa09 req-4001cc4a-b245-4b3a-b0c6-03f83ccef336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e", "name": "network-vif-plugged", "status": "completed", "tag": "fbcce620-dcf6-4f36-b99e-42b820797a20"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:14.382791 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:40:14.382791 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:40:14.392512 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-7eda89b7-b4a8-48c9-8c76-f42240c2fa09 req-4001cc4a-b245-4b3a-b0c6-03f83ccef336 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:14.394337 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-7eda89b7-b4a8-48c9-8c76-f42240c2fa09 req-4001cc4a-b245-4b3a-b0c6-03f83ccef336 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:14.405696 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-7eda89b7-b4a8-48c9-8c76-f42240c2fa09 req-4001cc4a-b245-4b3a-b0c6-03f83ccef336 service nova] Creating event network-vif-plugged:fbcce620-dcf6-4f36-b99e-42b820797a20 for instance cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e on hv-cinder-73306 Jul 28 03:40:14.410601 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-7eda89b7-b4a8-48c9-8c76-f42240c2fa09 req-4001cc4a-b245-4b3a-b0c6-03f83ccef336 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033613 Jul 28 03:40:14.411479 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 290/569] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:40:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:14.489296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b87c25ad-e78e-43ee-90b6-b59a93a50ae4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:14.496704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b87c25ad-e78e-43ee-90b6-b59a93a50ae4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.152570 Jul 28 03:40:14.497265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 280/570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:14 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:14.516068 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-54483424-3786-4cc2-b8b8-1f3e8449f7c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:14.516777 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-54483424-3786-4cc2-b8b8-1f3e8449f7c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:14.522746 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-54483424-3786-4cc2-b8b8-1f3e8449f7c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:14.523183 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-54483424-3786-4cc2-b8b8-1f3e8449f7c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:14.523995 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-54483424-3786-4cc2-b8b8-1f3e8449f7c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:14.524424 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-54483424-3786-4cc2-b8b8-1f3e8449f7c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:14.650454 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-54483424-3786-4cc2-b8b8-1f3e8449f7c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:14.658947 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-54483424-3786-4cc2-b8b8-1f3e8449f7c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.146814 Jul 28 03:40:14.659510 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 291/571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:14 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:14.993093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-574c62b0-15ef-46c6-a0fa-a1cdccc3a52e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:14.993698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-574c62b0-15ef-46c6-a0fa-a1cdccc3a52e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:15.000195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-574c62b0-15ef-46c6-a0fa-a1cdccc3a52e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:15.000638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-574c62b0-15ef-46c6-a0fa-a1cdccc3a52e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:15.001393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-574c62b0-15ef-46c6-a0fa-a1cdccc3a52e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:15.001823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-574c62b0-15ef-46c6-a0fa-a1cdccc3a52e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:15.122553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-574c62b0-15ef-46c6-a0fa-a1cdccc3a52e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:15.129929 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-574c62b0-15ef-46c6-a0fa-a1cdccc3a52e tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1512 microversion: 2.1 time: 0.140509 Jul 28 03:40:15.135760 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 281/572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:14 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1512 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:15.358269 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d5feb3e8-6690-4359-8583-1d91cecb7951 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:15.358863 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d5feb3e8-6690-4359-8583-1d91cecb7951 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:15.364772 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5feb3e8-6690-4359-8583-1d91cecb7951 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:15.365218 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5feb3e8-6690-4359-8583-1d91cecb7951 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:15.365979 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5feb3e8-6690-4359-8583-1d91cecb7951 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:15.366417 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5feb3e8-6690-4359-8583-1d91cecb7951 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:15.486458 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d5feb3e8-6690-4359-8583-1d91cecb7951 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:15.495127 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d5feb3e8-6690-4359-8583-1d91cecb7951 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:15.496636 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d5feb3e8-6690-4359-8583-1d91cecb7951 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:15.497755 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d5feb3e8-6690-4359-8583-1d91cecb7951 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.144877 Jul 28 03:40:15.498306 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 292/573] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:15 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:15.513477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a25c0097-1858-48b3-a4a4-e382bd416b16 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:15.514094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a25c0097-1858-48b3-a4a4-e382bd416b16 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:15.520105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a25c0097-1858-48b3-a4a4-e382bd416b16 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:15.520561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a25c0097-1858-48b3-a4a4-e382bd416b16 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:15.521345 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a25c0097-1858-48b3-a4a4-e382bd416b16 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:15.521783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a25c0097-1858-48b3-a4a4-e382bd416b16 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:15.654283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a25c0097-1858-48b3-a4a4-e382bd416b16 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:15.661580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a25c0097-1858-48b3-a4a4-e382bd416b16 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.151887 Jul 28 03:40:15.662557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 282/574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:15 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:15.675677 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-dae7a77f-f087-4336-854e-a6635cb96c2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:15.676317 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-dae7a77f-f087-4336-854e-a6635cb96c2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:15.682796 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dae7a77f-f087-4336-854e-a6635cb96c2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:15.683247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dae7a77f-f087-4336-854e-a6635cb96c2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:15.684046 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dae7a77f-f087-4336-854e-a6635cb96c2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:15.684485 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-dae7a77f-f087-4336-854e-a6635cb96c2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:15.898364 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-dae7a77f-f087-4336-854e-a6635cb96c2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:15.906000 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-dae7a77f-f087-4336-854e-a6635cb96c2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1260 microversion: 2.1 time: 0.233954 Jul 28 03:40:15.906562 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 293/575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:15 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:16.068146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-e6212ffe-8b07-4605-8cec-03071836d20f req-e0839bcd-c59c-4f2a-97d7-5ea0fddc299e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b227749a-44c6-4ab6-8c93-95345fba06ba", "name": "network-vif-deleted", "tag": "77bcf32c-4248-435a-be8b-cbf0a47caa64"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:16.069775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:40:16.069775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:40:16.077987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-e6212ffe-8b07-4605-8cec-03071836d20f req-e0839bcd-c59c-4f2a-97d7-5ea0fddc299e service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:16.078432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-e6212ffe-8b07-4605-8cec-03071836d20f req-e0839bcd-c59c-4f2a-97d7-5ea0fddc299e service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:16.089896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-e6212ffe-8b07-4605-8cec-03071836d20f req-e0839bcd-c59c-4f2a-97d7-5ea0fddc299e service nova] Creating event network-vif-deleted:77bcf32c-4248-435a-be8b-cbf0a47caa64 for instance b227749a-44c6-4ab6-8c93-95345fba06ba on hv-cinder-73306 Jul 28 03:40:16.094558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-e6212ffe-8b07-4605-8cec-03071836d20f req-e0839bcd-c59c-4f2a-97d7-5ea0fddc299e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030057 Jul 28 03:40:16.095124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 283/576] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:40:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:16.147406 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a41e4d6a-2656-4bb8-8273-fb42d6676b8d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:16.147972 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a41e4d6a-2656-4bb8-8273-fb42d6676b8d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:16.154731 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a41e4d6a-2656-4bb8-8273-fb42d6676b8d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:16.155175 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a41e4d6a-2656-4bb8-8273-fb42d6676b8d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:16.155979 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a41e4d6a-2656-4bb8-8273-fb42d6676b8d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:16.156414 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a41e4d6a-2656-4bb8-8273-fb42d6676b8d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:16.218588 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a41e4d6a-2656-4bb8-8273-fb42d6676b8d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3ecf43d42c74783a82bf45afd8826e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da239fd2931445e6be6459a0225fbd85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:16.226319 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a41e4d6a-2656-4bb8-8273-fb42d6676b8d tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 200 len: 1302 microversion: 2.1 time: 0.082612 Jul 28 03:40:16.226871 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 294/577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:16 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:16.517204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8a5ebe59-2d52-4e3d-b351-7ea57d6d0955 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:16.517800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8a5ebe59-2d52-4e3d-b351-7ea57d6d0955 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:16.523849 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a5ebe59-2d52-4e3d-b351-7ea57d6d0955 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:16.524298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a5ebe59-2d52-4e3d-b351-7ea57d6d0955 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:16.525058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a5ebe59-2d52-4e3d-b351-7ea57d6d0955 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:16.525668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a5ebe59-2d52-4e3d-b351-7ea57d6d0955 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:16.646744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8a5ebe59-2d52-4e3d-b351-7ea57d6d0955 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:16.655332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8a5ebe59-2d52-4e3d-b351-7ea57d6d0955 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:16.656839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8a5ebe59-2d52-4e3d-b351-7ea57d6d0955 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:16.657957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8a5ebe59-2d52-4e3d-b351-7ea57d6d0955 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.144902 Jul 28 03:40:16.658497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 284/578] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:16 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:16.679337 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e0ae6d50-78f4-4933-8e7b-a536a9a5dd25 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:16.680186 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e0ae6d50-78f4-4933-8e7b-a536a9a5dd25 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:16.686224 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e0ae6d50-78f4-4933-8e7b-a536a9a5dd25 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:16.686667 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e0ae6d50-78f4-4933-8e7b-a536a9a5dd25 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:16.687432 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e0ae6d50-78f4-4933-8e7b-a536a9a5dd25 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:16.687893 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e0ae6d50-78f4-4933-8e7b-a536a9a5dd25 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:16.818607 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e0ae6d50-78f4-4933-8e7b-a536a9a5dd25 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:16.825784 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e0ae6d50-78f4-4933-8e7b-a536a9a5dd25 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.150202 Jul 28 03:40:16.826342 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 295/579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:16 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:16.922428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ffb5ec60-d631-4b47-89cf-dcfd2de17d08 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:16.923042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ffb5ec60-d631-4b47-89cf-dcfd2de17d08 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:16.928987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ffb5ec60-d631-4b47-89cf-dcfd2de17d08 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:16.929443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ffb5ec60-d631-4b47-89cf-dcfd2de17d08 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:16.930214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ffb5ec60-d631-4b47-89cf-dcfd2de17d08 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:16.930681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ffb5ec60-d631-4b47-89cf-dcfd2de17d08 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:17.056131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ffb5ec60-d631-4b47-89cf-dcfd2de17d08 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:17.064194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ffb5ec60-d631-4b47-89cf-dcfd2de17d08 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1444 microversion: 2.1 time: 0.145220 Jul 28 03:40:17.064665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 285/580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:16 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:17.081062 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-718f3f87-2bb0-47b3-862b-4f5ac01e1c4a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:17.081659 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-718f3f87-2bb0-47b3-862b-4f5ac01e1c4a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:17.087787 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-718f3f87-2bb0-47b3-862b-4f5ac01e1c4a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:17.089018 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-718f3f87-2bb0-47b3-862b-4f5ac01e1c4a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:17.089871 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-718f3f87-2bb0-47b3-862b-4f5ac01e1c4a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:17.090362 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-718f3f87-2bb0-47b3-862b-4f5ac01e1c4a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:17.222849 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-718f3f87-2bb0-47b3-862b-4f5ac01e1c4a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:17.230860 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-718f3f87-2bb0-47b3-862b-4f5ac01e1c4a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1444 microversion: 2.1 time: 0.153428 Jul 28 03:40:17.231409 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 296/581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:17 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:17.242212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-caada689-1b63-4670-a421-4e67512dadc9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:17.242701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-caada689-1b63-4670-a421-4e67512dadc9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] [instance: b227749a-44c6-4ab6-8c93-95345fba06ba] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:17.249321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caada689-1b63-4670-a421-4e67512dadc9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:17.249457 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caada689-1b63-4670-a421-4e67512dadc9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:17.250406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caada689-1b63-4670-a421-4e67512dadc9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:17.250850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caada689-1b63-4670-a421-4e67512dadc9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:17.264827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-caada689-1b63-4670-a421-4e67512dadc9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] HTTP exception thrown: Instance b227749a-44c6-4ab6-8c93-95345fba06ba could not be found. Jul 28 03:40:17.265805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-caada689-1b63-4670-a421-4e67512dadc9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] Returning 404 to user: Instance b227749a-44c6-4ab6-8c93-95345fba06ba could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:40:17.266645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-caada689-1b63-4670-a421-4e67512dadc9 tempest-AttachVolumeNegativeTest-1110005397 tempest-AttachVolumeNegativeTest-1110005397-project] 10.222.0.16 "GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba" status: 404 len: 111 microversion: 2.1 time: 0.028243 Jul 28 03:40:17.267191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 286/582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:17 2021] GET /compute/v2.1/servers/b227749a-44c6-4ab6-8c93-95345fba06ba => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:17.676094 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-3a0b7af3-7f4b-4d4a-9f73-de9878c02a1e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:17.676697 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-3a0b7af3-7f4b-4d4a-9f73-de9878c02a1e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:17.682931 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3a0b7af3-7f4b-4d4a-9f73-de9878c02a1e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:17.684077 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3a0b7af3-7f4b-4d4a-9f73-de9878c02a1e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:17.685054 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3a0b7af3-7f4b-4d4a-9f73-de9878c02a1e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:17.685674 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-3a0b7af3-7f4b-4d4a-9f73-de9878c02a1e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:17.844514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6d66d8be-e76c-406d-8cbc-21e9f41a9633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:17.845547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6d66d8be-e76c-406d-8cbc-21e9f41a9633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:17.851868 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6d66d8be-e76c-406d-8cbc-21e9f41a9633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:17.852404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6d66d8be-e76c-406d-8cbc-21e9f41a9633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:17.853416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6d66d8be-e76c-406d-8cbc-21e9f41a9633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:17.853926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6d66d8be-e76c-406d-8cbc-21e9f41a9633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:18.040138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6d66d8be-e76c-406d-8cbc-21e9f41a9633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:18.053567 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3a0b7af3-7f4b-4d4a-9f73-de9878c02a1e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:18.058026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6d66d8be-e76c-406d-8cbc-21e9f41a9633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.218831 Jul 28 03:40:18.058612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 287/583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:17 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:18.073969 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3a0b7af3-7f4b-4d4a-9f73-de9878c02a1e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:18.075445 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-3a0b7af3-7f4b-4d4a-9f73-de9878c02a1e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:18.076622 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-3a0b7af3-7f4b-4d4a-9f73-de9878c02a1e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.404222 Jul 28 03:40:18.077172 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 297/584] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:17 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:19.075611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3b99a29e-e3dd-4c14-9b80-e7562c622478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:19.077060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3b99a29e-e3dd-4c14-9b80-e7562c622478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:19.084439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b99a29e-e3dd-4c14-9b80-e7562c622478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:19.085218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b99a29e-e3dd-4c14-9b80-e7562c622478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:19.086180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b99a29e-e3dd-4c14-9b80-e7562c622478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:19.086984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b99a29e-e3dd-4c14-9b80-e7562c622478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:19.095486 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f1140570-7732-4040-9fdd-3cbebb26dea3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:19.097359 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f1140570-7732-4040-9fdd-3cbebb26dea3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:19.117537 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f1140570-7732-4040-9fdd-3cbebb26dea3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:19.121859 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f1140570-7732-4040-9fdd-3cbebb26dea3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:19.122732 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f1140570-7732-4040-9fdd-3cbebb26dea3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:19.123155 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f1140570-7732-4040-9fdd-3cbebb26dea3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:19.301939 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f1140570-7732-4040-9fdd-3cbebb26dea3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:19.310862 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f1140570-7732-4040-9fdd-3cbebb26dea3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:19.312393 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f1140570-7732-4040-9fdd-3cbebb26dea3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:19.313533 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f1140570-7732-4040-9fdd-3cbebb26dea3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.223074 Jul 28 03:40:19.314321 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 298/585] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:19 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:40:19.438573 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c27b0c1e-aba4-4238-be58-b18f53a4bac7 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Action: 'create', calling method: .version_select at 0x7f68073af550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1731433238"}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:19.552572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3b99a29e-e3dd-4c14-9b80-e7562c622478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:19.562012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3b99a29e-e3dd-4c14-9b80-e7562c622478 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.490049 Jul 28 03:40:19.570075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 288/586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:19 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:19.756733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-cd83be1b-a6fe-4780-87ee-8b0149ce50b3 req-465e98d3-26cd-47a5-b19c-25566bf4fad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e", "tag": "fbcce620-dcf6-4f36-b99e-42b820797a20"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:19.758405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:40:19.758405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:40:19.768071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-cd83be1b-a6fe-4780-87ee-8b0149ce50b3 req-465e98d3-26cd-47a5-b19c-25566bf4fad9 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:19.769044 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-cd83be1b-a6fe-4780-87ee-8b0149ce50b3 req-465e98d3-26cd-47a5-b19c-25566bf4fad9 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:19.782374 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c27b0c1e-aba4-4238-be58-b18f53a4bac7 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.467006 Jul 28 03:40:19.783037 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 299/587] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Jul 28 03:40:19 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 468 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 03:40:19.787729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-cd83be1b-a6fe-4780-87ee-8b0149ce50b3 req-465e98d3-26cd-47a5-b19c-25566bf4fad9 service nova] Creating event network-changed:fbcce620-dcf6-4f36-b99e-42b820797a20 for instance cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e on hv-cinder-73306 Jul 28 03:40:19.794563 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f05bb924-95d2-4ebe-a034-76d69c61de2b tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f68072f3ca0>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:19.795310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-cd83be1b-a6fe-4780-87ee-8b0149ce50b3 req-465e98d3-26cd-47a5-b19c-25566bf4fad9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044681 Jul 28 03:40:19.800836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 289/588] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:40:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:19.849780 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f05bb924-95d2-4ebe-a034-76d69c61de2b tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670" status: 200 len: 345 microversion: 2.1 time: 0.059762 Jul 28 03:40:19.850345 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 300/589] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Jul 28 03:40:19 2021] GET /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:40:20.333637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-15ba335d-fac1-4947-802e-028611bc8d7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:20.335018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-15ba335d-fac1-4947-802e-028611bc8d7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:20.359151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-15ba335d-fac1-4947-802e-028611bc8d7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:20.360547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-15ba335d-fac1-4947-802e-028611bc8d7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:20.361625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-15ba335d-fac1-4947-802e-028611bc8d7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:20.362554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-15ba335d-fac1-4947-802e-028611bc8d7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:20.412802 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-1f5cd413-d829-4f9c-8315-3b438b05b31d req-a32c0ef8-6f7a-4aa4-bdbf-c7aa4a929550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622af242-a6fc-4f2d-9f03-61e88ee5e89f", "name": "network-vif-plugged", "status": "completed", "tag": "f743ec9f-b513-4bb3-b819-5c932959e75f"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:20.416432 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:40:20.416432 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:40:20.429016 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-1f5cd413-d829-4f9c-8315-3b438b05b31d req-a32c0ef8-6f7a-4aa4-bdbf-c7aa4a929550 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:20.429451 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-1f5cd413-d829-4f9c-8315-3b438b05b31d req-a32c0ef8-6f7a-4aa4-bdbf-c7aa4a929550 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:20.450875 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-1f5cd413-d829-4f9c-8315-3b438b05b31d req-a32c0ef8-6f7a-4aa4-bdbf-c7aa4a929550 service nova] Creating event network-vif-plugged:f743ec9f-b513-4bb3-b819-5c932959e75f for instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f on hv-cinder-73306 Jul 28 03:40:20.456476 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-1f5cd413-d829-4f9c-8315-3b438b05b31d req-a32c0ef8-6f7a-4aa4-bdbf-c7aa4a929550 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047624 Jul 28 03:40:20.457778 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 301/590] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:20.545414 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-15ba335d-fac1-4947-802e-028611bc8d7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:20.554253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-15ba335d-fac1-4947-802e-028611bc8d7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:20.556129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-15ba335d-fac1-4947-802e-028611bc8d7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:20.558525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-15ba335d-fac1-4947-802e-028611bc8d7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.229480 Jul 28 03:40:20.559297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 290/591] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:20 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:20.579725 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-083c9f46-7edc-4fef-8cda-cff3100f76f1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:20.580427 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-083c9f46-7edc-4fef-8cda-cff3100f76f1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:20.586583 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-083c9f46-7edc-4fef-8cda-cff3100f76f1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:20.587035 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-083c9f46-7edc-4fef-8cda-cff3100f76f1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:20.588493 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-083c9f46-7edc-4fef-8cda-cff3100f76f1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:20.588932 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-083c9f46-7edc-4fef-8cda-cff3100f76f1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:20.724977 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-083c9f46-7edc-4fef-8cda-cff3100f76f1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:20.732869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-083c9f46-7edc-4fef-8cda-cff3100f76f1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.157015 Jul 28 03:40:20.733642 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 302/592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:20 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:20.862190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6b7def84-9e01-4681-8417-89095b7132a7 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f6806935310>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:20.914138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6b7def84-9e01-4681-8417-89095b7132a7 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670" status: 200 len: 346 microversion: 2.1 time: 0.055578 Jul 28 03:40:20.914705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 291/593] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Jul 28 03:40:20 2021] GET /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:20.925506 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a036afea-442c-4fe5-bdcd-61e88e61eb43 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Action: 'create', calling method: .version_select at 0x7f68073a9940>, body: {"snapshot": {"volume_id": "6f681dc2-a250-48b7-b4fa-f16d63d03670", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-303470737"}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:21.074238 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a036afea-442c-4fe5-bdcd-61e88e61eb43 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.152293 Jul 28 03:40:21.074890 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 303/594] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Jul 28 03:40:20 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:21.084499 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-725e43e2-5475-42ce-af93-1f4bbb8bf236 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f6806942b80>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:21.114737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-725e43e2-5475-42ce-af93-1f4bbb8bf236 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0" status: 200 len: 286 microversion: 2.1 time: 0.033938 Jul 28 03:40:21.115384 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 292/595] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Jul 28 03:40:21 2021] GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:21.128075 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-355d4209-cc0a-4e8d-bae9-cdbc7510d5b9 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f68072f31f0>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:21.159318 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-355d4209-cc0a-4e8d-bae9-cdbc7510d5b9 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035449 Jul 28 03:40:21.159920 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 304/596] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Jul 28 03:40:21 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:21.169819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6ee7d591-835d-4cba-b5ca-b0829d836ac7 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f6806957430>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:21.199153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6ee7d591-835d-4cba-b5ca-b0829d836ac7 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0" status: 200 len: 286 microversion: 2.1 time: 0.032967 Jul 28 03:40:21.199728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 293/597] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Jul 28 03:40:21 2021] GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:21.576666 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-bc55ac3f-242b-44be-be2f-3aea3294ac68 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:21.577340 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-bc55ac3f-242b-44be-be2f-3aea3294ac68 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:21.585035 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bc55ac3f-242b-44be-be2f-3aea3294ac68 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:21.585486 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bc55ac3f-242b-44be-be2f-3aea3294ac68 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:21.586266 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bc55ac3f-242b-44be-be2f-3aea3294ac68 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:21.586698 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-bc55ac3f-242b-44be-be2f-3aea3294ac68 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:21.707181 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-bc55ac3f-242b-44be-be2f-3aea3294ac68 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:21.716027 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-bc55ac3f-242b-44be-be2f-3aea3294ac68 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:21.717510 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-bc55ac3f-242b-44be-be2f-3aea3294ac68 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:21.718636 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-bc55ac3f-242b-44be-be2f-3aea3294ac68 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.145680 Jul 28 03:40:21.719194 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 305/598] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:21 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:21.749117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c6ca3612-0777-4d35-b7f3-ad8d668342d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:21.749762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c6ca3612-0777-4d35-b7f3-ad8d668342d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:21.756369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6ca3612-0777-4d35-b7f3-ad8d668342d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:21.757073 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6ca3612-0777-4d35-b7f3-ad8d668342d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:21.758078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6ca3612-0777-4d35-b7f3-ad8d668342d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:21.758695 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6ca3612-0777-4d35-b7f3-ad8d668342d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:21.879051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c6ca3612-0777-4d35-b7f3-ad8d668342d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:21.886316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c6ca3612-0777-4d35-b7f3-ad8d668342d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.140861 Jul 28 03:40:21.886870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 294/599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:21 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:22.210475 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-986d464d-ca6f-400c-8a6d-2a01a22ffc26 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f68073af940>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:22.239386 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-986d464d-ca6f-400c-8a6d-2a01a22ffc26 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0" status: 200 len: 286 microversion: 2.1 time: 0.032430 Jul 28 03:40:22.239969 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 306/600] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Jul 28 03:40:22 2021] GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:22.737374 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5b00279e-6490-4562-8e45-b90860fd3197 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:22.737889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5b00279e-6490-4562-8e45-b90860fd3197 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:22.743850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b00279e-6490-4562-8e45-b90860fd3197 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:22.744484 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b00279e-6490-4562-8e45-b90860fd3197 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:22.745293 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b00279e-6490-4562-8e45-b90860fd3197 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:22.745740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b00279e-6490-4562-8e45-b90860fd3197 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:22.866216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5b00279e-6490-4562-8e45-b90860fd3197 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:22.874542 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5b00279e-6490-4562-8e45-b90860fd3197 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:22.876038 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5b00279e-6490-4562-8e45-b90860fd3197 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:22.877155 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5b00279e-6490-4562-8e45-b90860fd3197 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.143559 Jul 28 03:40:22.877701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 295/601] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:22 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:22.905321 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-686def89-b1e2-47fd-b089-4c3a805a6fdc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:22.906072 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-686def89-b1e2-47fd-b089-4c3a805a6fdc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:22.913138 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-686def89-b1e2-47fd-b089-4c3a805a6fdc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:22.913594 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-686def89-b1e2-47fd-b089-4c3a805a6fdc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:22.914416 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-686def89-b1e2-47fd-b089-4c3a805a6fdc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:22.914875 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-686def89-b1e2-47fd-b089-4c3a805a6fdc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:23.041948 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-686def89-b1e2-47fd-b089-4c3a805a6fdc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:23.049120 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-686def89-b1e2-47fd-b089-4c3a805a6fdc tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.149709 Jul 28 03:40:23.049685 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 307/602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:22 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:23.250958 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c2538ca4-bd90-4bf0-9bab-82a23b5b0431 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f6806957ee0>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:23.279826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c2538ca4-bd90-4bf0-9bab-82a23b5b0431 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0" status: 200 len: 286 microversion: 2.1 time: 0.032532 Jul 28 03:40:23.280392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 296/603] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Jul 28 03:40:23 2021] GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:23.896107 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5aed7d40-91bb-4c27-9cfc-acaf78f21a0f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:23.896628 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5aed7d40-91bb-4c27-9cfc-acaf78f21a0f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:23.902637 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5aed7d40-91bb-4c27-9cfc-acaf78f21a0f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:23.903086 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5aed7d40-91bb-4c27-9cfc-acaf78f21a0f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:23.903884 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5aed7d40-91bb-4c27-9cfc-acaf78f21a0f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:23.904321 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5aed7d40-91bb-4c27-9cfc-acaf78f21a0f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:24.023068 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5aed7d40-91bb-4c27-9cfc-acaf78f21a0f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:24.032289 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5aed7d40-91bb-4c27-9cfc-acaf78f21a0f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:24.033787 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5aed7d40-91bb-4c27-9cfc-acaf78f21a0f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:24.034919 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5aed7d40-91bb-4c27-9cfc-acaf78f21a0f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.142685 Jul 28 03:40:24.035469 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 308/604] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:23 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:24.065881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8c7068c1-5e29-480f-81f1-d190a2d79925 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:24.066486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8c7068c1-5e29-480f-81f1-d190a2d79925 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:24.072239 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8c7068c1-5e29-480f-81f1-d190a2d79925 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:24.072697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8c7068c1-5e29-480f-81f1-d190a2d79925 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:24.073453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8c7068c1-5e29-480f-81f1-d190a2d79925 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:24.073882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8c7068c1-5e29-480f-81f1-d190a2d79925 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:24.199746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8c7068c1-5e29-480f-81f1-d190a2d79925 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:24.207067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8c7068c1-5e29-480f-81f1-d190a2d79925 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.144832 Jul 28 03:40:24.207635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 297/605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:24 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:24.290479 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-745e79d7-5108-46c0-a2cb-ae399fba7e6d tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f6807300a60>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:24.319249 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-745e79d7-5108-46c0-a2cb-ae399fba7e6d tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0" status: 200 len: 286 microversion: 2.1 time: 0.032346 Jul 28 03:40:24.319809 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 309/606] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Jul 28 03:40:24 2021] GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:25.053999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8d7d5de2-f333-422d-a278-de2891d25ef5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:25.054610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8d7d5de2-f333-422d-a278-de2891d25ef5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:25.065595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d7d5de2-f333-422d-a278-de2891d25ef5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:25.065595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d7d5de2-f333-422d-a278-de2891d25ef5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:25.065595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d7d5de2-f333-422d-a278-de2891d25ef5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:25.065595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d7d5de2-f333-422d-a278-de2891d25ef5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:25.197481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d7d5de2-f333-422d-a278-de2891d25ef5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:25.205664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d7d5de2-f333-422d-a278-de2891d25ef5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:25.207168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d7d5de2-f333-422d-a278-de2891d25ef5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:25.208338 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8d7d5de2-f333-422d-a278-de2891d25ef5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.158103 Jul 28 03:40:25.208882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 298/607] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:25 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:25.224440 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d74db82a-ec49-4faf-959a-e7252f549e8d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:25.225055 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d74db82a-ec49-4faf-959a-e7252f549e8d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:25.231590 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d74db82a-ec49-4faf-959a-e7252f549e8d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:25.232079 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d74db82a-ec49-4faf-959a-e7252f549e8d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:25.232866 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d74db82a-ec49-4faf-959a-e7252f549e8d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:25.233298 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d74db82a-ec49-4faf-959a-e7252f549e8d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:25.329969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a2035d9d-721e-4b2c-89eb-f3ceaaeff9ed tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f680692b1f0>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:25.358203 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d74db82a-ec49-4faf-959a-e7252f549e8d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:25.361492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a2035d9d-721e-4b2c-89eb-f3ceaaeff9ed tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0" status: 200 len: 287 microversion: 2.1 time: 0.034995 Jul 28 03:40:25.362087 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 299/608] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Jul 28 03:40:25 2021] GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:40:25.365559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d74db82a-ec49-4faf-959a-e7252f549e8d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.144974 Jul 28 03:40:25.366113 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 310/609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:25 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:25.372784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c8fd0b26-14cd-4c21-8a95-182a4c677d62 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f6806957820>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:25.424314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c8fd0b26-14cd-4c21-8a95-182a4c677d62 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0" status: 202 len: 0 microversion: 2.1 time: 0.055672 Jul 28 03:40:25.424880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 300/610] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Jul 28 03:40:25 2021] DELETE /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:40:25.433214 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-25314393-90df-498b-a490-8c0c4e6fb269 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f680739b3a0>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:25.460976 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-25314393-90df-498b-a490-8c0c4e6fb269 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0" status: 200 len: 286 microversion: 2.1 time: 0.031914 Jul 28 03:40:25.461521 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 311/611] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Jul 28 03:40:25 2021] GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:26.226649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-59fd1d20-d40a-45a1-beac-54b47141b1be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:26.227372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-59fd1d20-d40a-45a1-beac-54b47141b1be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:26.234173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59fd1d20-d40a-45a1-beac-54b47141b1be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:26.234700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59fd1d20-d40a-45a1-beac-54b47141b1be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:26.235498 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59fd1d20-d40a-45a1-beac-54b47141b1be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:26.235976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59fd1d20-d40a-45a1-beac-54b47141b1be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:26.366028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-59fd1d20-d40a-45a1-beac-54b47141b1be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:26.374983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-59fd1d20-d40a-45a1-beac-54b47141b1be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:26.376527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-59fd1d20-d40a-45a1-beac-54b47141b1be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:26.377773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-59fd1d20-d40a-45a1-beac-54b47141b1be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1805 microversion: 2.20 time: 0.155061 Jul 28 03:40:26.378332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 301/612] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:26 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:26.382263 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-43afd533-07c8-4460-b572-262de7fcf633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:26.382876 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-43afd533-07c8-4460-b572-262de7fcf633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:26.389736 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-43afd533-07c8-4460-b572-262de7fcf633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:26.390239 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-43afd533-07c8-4460-b572-262de7fcf633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:26.390959 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-43afd533-07c8-4460-b572-262de7fcf633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:26.391391 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-43afd533-07c8-4460-b572-262de7fcf633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:26.472134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e4435bde-506d-4607-9c3e-5a32530e98ad tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f6806942a60>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:26.495945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-e4435bde-506d-4607-9c3e-5a32530e98ad tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] HTTP exception thrown: Snapshot 4c08e5dd-2ca2-4a76-92b5-04f0269152b0 could not be found. Jul 28 03:40:26.496547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e4435bde-506d-4607-9c3e-5a32530e98ad tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Returning 404 to user: Snapshot 4c08e5dd-2ca2-4a76-92b5-04f0269152b0 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:40:26.497381 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e4435bde-506d-4607-9c3e-5a32530e98ad tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0" status: 404 len: 111 microversion: 2.1 time: 0.029195 Jul 28 03:40:26.497929 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 302/613] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Jul 28 03:40:26 2021] GET /compute/v2.1/os-snapshots/4c08e5dd-2ca2-4a76-92b5-04f0269152b0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:40:26.506584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ce3e7b1b-8b67-4666-8064-9f0b57838269 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f6806957790>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:26.519455 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-43afd533-07c8-4460-b572-262de7fcf633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:26.527932 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-43afd533-07c8-4460-b572-262de7fcf633 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.149397 Jul 28 03:40:26.528519 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 312/614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:26 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:26.577027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ce3e7b1b-8b67-4666-8064-9f0b57838269 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670" status: 202 len: 0 microversion: 2.1 time: 0.074623 Jul 28 03:40:26.577593 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 303/615] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Jul 28 03:40:26 2021] DELETE /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:40:26.585702 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ffdd6298-464c-4b3f-9c83-e2942b9827f9 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f68073a9550>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:26.639241 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ffdd6298-464c-4b3f-9c83-e2942b9827f9 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670" status: 200 len: 345 microversion: 2.1 time: 0.057076 Jul 28 03:40:26.639834 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 313/616] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Jul 28 03:40:26 2021] GET /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:27.396789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5622be1a-6a3e-4434-b4a7-ab56c57ece0a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:27.397328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5622be1a-6a3e-4434-b4a7-ab56c57ece0a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:27.404024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5622be1a-6a3e-4434-b4a7-ab56c57ece0a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:27.404473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5622be1a-6a3e-4434-b4a7-ab56c57ece0a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:27.405240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5622be1a-6a3e-4434-b4a7-ab56c57ece0a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:27.405674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5622be1a-6a3e-4434-b4a7-ab56c57ece0a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:27.529875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5622be1a-6a3e-4434-b4a7-ab56c57ece0a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:27.539212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5622be1a-6a3e-4434-b4a7-ab56c57ece0a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:27.540790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5622be1a-6a3e-4434-b4a7-ab56c57ece0a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:27.542088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5622be1a-6a3e-4434-b4a7-ab56c57ece0a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1792 microversion: 2.20 time: 0.149014 Jul 28 03:40:27.545494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 304/617] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:40:27 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1792 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:27.545673 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-79f1dbf3-d821-439a-a53e-49de067f0fc0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:27.545673 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-79f1dbf3-d821-439a-a53e-49de067f0fc0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:27.551554 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79f1dbf3-d821-439a-a53e-49de067f0fc0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:27.552048 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79f1dbf3-d821-439a-a53e-49de067f0fc0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:27.552840 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79f1dbf3-d821-439a-a53e-49de067f0fc0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:27.553283 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-79f1dbf3-d821-439a-a53e-49de067f0fc0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:27.651301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-068ab58a-f8bc-41c4-b21f-871a44fabb49 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f6807d0b820>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:27.674198 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-79f1dbf3-d821-439a-a53e-49de067f0fc0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:27.677654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-068ab58a-f8bc-41c4-b21f-871a44fabb49 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] HTTP exception thrown: Volume 6f681dc2-a250-48b7-b4fa-f16d63d03670 could not be found. Jul 28 03:40:27.678244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-068ab58a-f8bc-41c4-b21f-871a44fabb49 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Returning 404 to user: Volume 6f681dc2-a250-48b7-b4fa-f16d63d03670 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:40:27.679059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-068ab58a-f8bc-41c4-b21f-871a44fabb49 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670" status: 404 len: 109 microversion: 2.1 time: 0.031620 Jul 28 03:40:27.679587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 305/618] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Jul 28 03:40:27 2021] GET /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:40:27.682178 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-79f1dbf3-d821-439a-a53e-49de067f0fc0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.141324 Jul 28 03:40:27.683226 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 314/619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:27 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:27.693315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4616f7c0-fb95-4e69-ba57-781f7b33d008 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f68069574c0>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:27.720495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-4616f7c0-fb95-4e69-ba57-781f7b33d008 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] HTTP exception thrown: Volume 6f681dc2-a250-48b7-b4fa-f16d63d03670 could not be found. Jul 28 03:40:27.721108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4616f7c0-fb95-4e69-ba57-781f7b33d008 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Returning 404 to user: Volume 6f681dc2-a250-48b7-b4fa-f16d63d03670 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:40:27.721913 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4616f7c0-fb95-4e69-ba57-781f7b33d008 tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670" status: 404 len: 109 microversion: 2.1 time: 0.032043 Jul 28 03:40:27.722426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 306/620] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Jul 28 03:40:27 2021] DELETE /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:27.730082 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8ade4827-1cb9-404f-aa0e-140f5223440c tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Calling method '.version_select at 0x7f68073a9700>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:27.756966 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-8ade4827-1cb9-404f-aa0e-140f5223440c tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] HTTP exception thrown: Volume 6f681dc2-a250-48b7-b4fa-f16d63d03670 could not be found. Jul 28 03:40:27.757558 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8ade4827-1cb9-404f-aa0e-140f5223440c tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] Returning 404 to user: Volume 6f681dc2-a250-48b7-b4fa-f16d63d03670 could not be found. {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:40:27.758411 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8ade4827-1cb9-404f-aa0e-140f5223440c tempest-VolumesSnapshotsTestJSON-49755454 tempest-VolumesSnapshotsTestJSON-49755454-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670" status: 404 len: 109 microversion: 2.1 time: 0.032051 Jul 28 03:40:27.759007 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 315/621] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Jul 28 03:40:27 2021] GET /compute/v2.1/os-volumes/6f681dc2-a250-48b7-b4fa-f16d63d03670 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:28.697963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-58ada1e0-6cd0-429c-afb6-6acf87516a59 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:28.699668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-58ada1e0-6cd0-429c-afb6-6acf87516a59 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:28.705891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-58ada1e0-6cd0-429c-afb6-6acf87516a59 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:28.706287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-58ada1e0-6cd0-429c-afb6-6acf87516a59 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:28.707056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-58ada1e0-6cd0-429c-afb6-6acf87516a59 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:28.707967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-58ada1e0-6cd0-429c-afb6-6acf87516a59 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:28.832944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-58ada1e0-6cd0-429c-afb6-6acf87516a59 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:28.841302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-58ada1e0-6cd0-429c-afb6-6acf87516a59 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.146914 Jul 28 03:40:28.841866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 307/622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:28 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:29.858591 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2746ebaa-7c63-42cb-986d-eebba8842ec4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:29.859205 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2746ebaa-7c63-42cb-986d-eebba8842ec4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:29.865605 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2746ebaa-7c63-42cb-986d-eebba8842ec4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:29.866056 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2746ebaa-7c63-42cb-986d-eebba8842ec4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:29.866830 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2746ebaa-7c63-42cb-986d-eebba8842ec4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:29.867265 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2746ebaa-7c63-42cb-986d-eebba8842ec4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:29.997993 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-2746ebaa-7c63-42cb-986d-eebba8842ec4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:30.005738 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2746ebaa-7c63-42cb-986d-eebba8842ec4 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.151394 Jul 28 03:40:30.006304 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 316/623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:29 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:31.022131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6bce8608-cdf9-4a5e-ab94-94d803e65a3a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:31.022746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6bce8608-cdf9-4a5e-ab94-94d803e65a3a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:31.029284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6bce8608-cdf9-4a5e-ab94-94d803e65a3a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:31.029730 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6bce8608-cdf9-4a5e-ab94-94d803e65a3a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:31.030491 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6bce8608-cdf9-4a5e-ab94-94d803e65a3a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:31.030921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6bce8608-cdf9-4a5e-ab94-94d803e65a3a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:31.159441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6bce8608-cdf9-4a5e-ab94-94d803e65a3a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:31.167532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6bce8608-cdf9-4a5e-ab94-94d803e65a3a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.148988 Jul 28 03:40:31.168233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 308/624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:31 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:32.183820 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-6a3f2938-f99b-47ad-8727-53f5349ab1e1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:32.184602 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-6a3f2938-f99b-47ad-8727-53f5349ab1e1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:32.190445 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6a3f2938-f99b-47ad-8727-53f5349ab1e1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:32.190889 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6a3f2938-f99b-47ad-8727-53f5349ab1e1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:32.191662 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6a3f2938-f99b-47ad-8727-53f5349ab1e1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:32.192126 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6a3f2938-f99b-47ad-8727-53f5349ab1e1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:32.313455 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-6a3f2938-f99b-47ad-8727-53f5349ab1e1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:32.320613 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-6a3f2938-f99b-47ad-8727-53f5349ab1e1 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.140541 Jul 28 03:40:32.321165 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 317/625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:32 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:33.336348 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6e2b41ab-9445-4f02-9102-04287158b0d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:33.336897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6e2b41ab-9445-4f02-9102-04287158b0d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:33.342563 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e2b41ab-9445-4f02-9102-04287158b0d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:33.343018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e2b41ab-9445-4f02-9102-04287158b0d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:33.343796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e2b41ab-9445-4f02-9102-04287158b0d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:33.344239 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e2b41ab-9445-4f02-9102-04287158b0d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:33.469790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6e2b41ab-9445-4f02-9102-04287158b0d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:33.477275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6e2b41ab-9445-4f02-9102-04287158b0d5 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.144639 Jul 28 03:40:33.477833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 309/626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:33 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:34.270592 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f05ba46b-1a64-481f-af10-aa39e988ef97 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae576153-1647-46b6-9af2-7be9913ff5b7", "device": "/dev/sdb"}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:34.272258 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f05ba46b-1a64-481f-af10-aa39e988ef97 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:34.278057 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f05ba46b-1a64-481f-af10-aa39e988ef97 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:34.278508 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f05ba46b-1a64-481f-af10-aa39e988ef97 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:34.279281 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f05ba46b-1a64-481f-af10-aa39e988ef97 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:34.279716 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f05ba46b-1a64-481f-af10-aa39e988ef97 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:34.494679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a6060d35-0cec-416d-aa16-a33c0ecd32cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:34.495420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a6060d35-0cec-416d-aa16-a33c0ecd32cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:34.502255 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6060d35-0cec-416d-aa16-a33c0ecd32cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:34.502809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6060d35-0cec-416d-aa16-a33c0ecd32cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:34.503654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6060d35-0cec-416d-aa16-a33c0ecd32cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:34.504195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6060d35-0cec-416d-aa16-a33c0ecd32cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:34.538239 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f05ba46b-1a64-481f-af10-aa39e988ef97 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "POST /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270500 Jul 28 03:40:34.539814 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 318/627] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 03:40:34 2021] POST /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:34.642366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a6060d35-0cec-416d-aa16-a33c0ecd32cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:34.649919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a6060d35-0cec-416d-aa16-a33c0ecd32cb tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1500 microversion: 2.1 time: 0.159095 Jul 28 03:40:34.650484 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 310/628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:34 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:34.666943 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7ba2fb2a-9b5f-4115-8237-53d8536d658a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5ef37bf-96d2-4494-b4db-ae70fd8656b5"}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:34.668300 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-7ba2fb2a-9b5f-4115-8237-53d8536d658a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:34.674726 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7ba2fb2a-9b5f-4115-8237-53d8536d658a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:34.675182 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7ba2fb2a-9b5f-4115-8237-53d8536d658a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:34.675999 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7ba2fb2a-9b5f-4115-8237-53d8536d658a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:34.676437 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-7ba2fb2a-9b5f-4115-8237-53d8536d658a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:34.701641 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.wsgi [None req-7ba2fb2a-9b5f-4115-8237-53d8536d658a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] HTTP exception thrown: Cannot 'attach_volume' instance a9eae018-81cf-4d77-8ac7-562c54a93e53 while it is in vm_state rescued Jul 28 03:40:34.702231 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-7ba2fb2a-9b5f-4115-8237-53d8536d658a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Returning 409 to user: Cannot 'attach_volume' instance a9eae018-81cf-4d77-8ac7-562c54a93e53 while it is in vm_state rescued {{(pid=119155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:40:34.703063 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-7ba2fb2a-9b5f-4115-8237-53d8536d658a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "POST /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040604 Jul 28 03:40:34.703600 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 319/629] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 03:40:34 2021] POST /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:40:34.711852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-26887e2c-e72b-4218-bcaa-53976abf7c91 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:34.712488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-26887e2c-e72b-4218-bcaa-53976abf7c91 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:34.718779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26887e2c-e72b-4218-bcaa-53976abf7c91 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:34.719304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26887e2c-e72b-4218-bcaa-53976abf7c91 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:34.720168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26887e2c-e72b-4218-bcaa-53976abf7c91 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:34.720925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26887e2c-e72b-4218-bcaa-53976abf7c91 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:34.795340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-26887e2c-e72b-4218-bcaa-53976abf7c91 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "POST /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53/action" status: 202 len: 0 microversion: 2.1 time: 0.086618 Jul 28 03:40:34.796017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 311/630] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:40:34 2021] POST /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:40:34.804190 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2aedc22e-82d5-4c63-96f8-66240eb17de2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:34.805046 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2aedc22e-82d5-4c63-96f8-66240eb17de2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:34.811847 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2aedc22e-82d5-4c63-96f8-66240eb17de2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:34.812304 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2aedc22e-82d5-4c63-96f8-66240eb17de2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:34.813092 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2aedc22e-82d5-4c63-96f8-66240eb17de2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:34.813556 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2aedc22e-82d5-4c63-96f8-66240eb17de2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:35.021966 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-2aedc22e-82d5-4c63-96f8-66240eb17de2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:35.029537 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2aedc22e-82d5-4c63-96f8-66240eb17de2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1508 microversion: 2.1 time: 0.229207 Jul 28 03:40:35.030105 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 320/631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:34 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:36.046966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-078bdf2d-2307-46e0-875b-121627dff0db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:36.047663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-078bdf2d-2307-46e0-875b-121627dff0db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:36.054025 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-078bdf2d-2307-46e0-875b-121627dff0db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:36.054431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-078bdf2d-2307-46e0-875b-121627dff0db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:36.055182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-078bdf2d-2307-46e0-875b-121627dff0db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:36.055611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-078bdf2d-2307-46e0-875b-121627dff0db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:36.184726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-078bdf2d-2307-46e0-875b-121627dff0db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:36.192367 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-078bdf2d-2307-46e0-875b-121627dff0db tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1508 microversion: 2.1 time: 0.149491 Jul 28 03:40:36.192938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 312/632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:36 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:37.210380 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d9387c2b-8c79-4452-9f34-762682dba66a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:37.211208 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d9387c2b-8c79-4452-9f34-762682dba66a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:37.218822 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9387c2b-8c79-4452-9f34-762682dba66a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:37.219360 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9387c2b-8c79-4452-9f34-762682dba66a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:37.220250 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9387c2b-8c79-4452-9f34-762682dba66a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:37.221433 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d9387c2b-8c79-4452-9f34-762682dba66a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:37.567335 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d9387c2b-8c79-4452-9f34-762682dba66a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:37.574749 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d9387c2b-8c79-4452-9f34-762682dba66a tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1508 microversion: 2.1 time: 0.368672 Jul 28 03:40:37.576017 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 321/633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:37 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:38.433336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ee99dd90-3fee-45e9-b83a-1e7a6afe2552 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:38.433863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ee99dd90-3fee-45e9-b83a-1e7a6afe2552 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:38.440036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ee99dd90-3fee-45e9-b83a-1e7a6afe2552 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:38.440479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ee99dd90-3fee-45e9-b83a-1e7a6afe2552 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:38.441243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ee99dd90-3fee-45e9-b83a-1e7a6afe2552 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:38.441667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ee99dd90-3fee-45e9-b83a-1e7a6afe2552 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:38.531257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-ee99dd90-3fee-45e9-b83a-1e7a6afe2552 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lazy-loading 'services' on Instance uuid c0eb74a9-c89c-4863-9431-4de9be74c41c {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:40:38.591175 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d5c0f5fb-1c0a-44f5-a9f6-06d366919d5d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:38.592118 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d5c0f5fb-1c0a-44f5-a9f6-06d366919d5d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:38.598153 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5c0f5fb-1c0a-44f5-a9f6-06d366919d5d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:38.598576 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5c0f5fb-1c0a-44f5-a9f6-06d366919d5d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:38.603971 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5c0f5fb-1c0a-44f5-a9f6-06d366919d5d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:38.603971 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5c0f5fb-1c0a-44f5-a9f6-06d366919d5d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:38.604172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ee99dd90-3fee-45e9-b83a-1e7a6afe2552 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/os-volume_attachments/f5a68c7e-111a-41b9-adca-70cb7a1e37c1" status: 202 len: 0 microversion: 2.1 time: 0.170788 Jul 28 03:40:38.604172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 313/634] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Jul 28 03:40:38 2021] DELETE /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c/os-volume_attachments/f5a68c7e-111a-41b9-adca-70cb7a1e37c1 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:40:38.739395 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d5c0f5fb-1c0a-44f5-a9f6-06d366919d5d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:38.752696 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d5c0f5fb-1c0a-44f5-a9f6-06d366919d5d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1514 microversion: 2.1 time: 0.165162 Jul 28 03:40:38.753274 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 322/635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:38 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:40.104140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-82bb1723-d640-4eb5-9571-30c441cf4183 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:40.104854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-82bb1723-d640-4eb5-9571-30c441cf4183 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:40.111490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82bb1723-d640-4eb5-9571-30c441cf4183 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:40.111968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82bb1723-d640-4eb5-9571-30c441cf4183 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:40.112735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82bb1723-d640-4eb5-9571-30c441cf4183 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:40.113164 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82bb1723-d640-4eb5-9571-30c441cf4183 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:40.273344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-82bb1723-d640-4eb5-9571-30c441cf4183 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:40.280673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-82bb1723-d640-4eb5-9571-30c441cf4183 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1514 microversion: 2.1 time: 0.180630 Jul 28 03:40:40.281235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 314/636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:40:40 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:40.297405 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5d23bcd9-8625-44bd-9029-e424b7187c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55f6b1d2-75b6-43af-8cf1-e02f5ac9b487"}} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:40.298463 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5d23bcd9-8625-44bd-9029-e424b7187c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:40:40.309587 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5d23bcd9-8625-44bd-9029-e424b7187c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:40.310219 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5d23bcd9-8625-44bd-9029-e424b7187c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:40.311499 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5d23bcd9-8625-44bd-9029-e424b7187c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:40:40.311962 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5d23bcd9-8625-44bd-9029-e424b7187c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:40:40.581604 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5d23bcd9-8625-44bd-9029-e424b7187c14 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "POST /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288933 Jul 28 03:40:40.582199 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 323/637] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 03:40:40 2021] POST /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:15.358058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2b494a9b-00c9-48d0-9bef-f7d5cfc9d41e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:15.359143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2b494a9b-00c9-48d0-9bef-f7d5cfc9d41e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:41:15.365206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b494a9b-00c9-48d0-9bef-f7d5cfc9d41e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:41:15.365657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b494a9b-00c9-48d0-9bef-f7d5cfc9d41e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:41:15.366454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b494a9b-00c9-48d0-9bef-f7d5cfc9d41e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:41:15.366899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b494a9b-00c9-48d0-9bef-f7d5cfc9d41e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:41:15.395595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2b494a9b-00c9-48d0-9bef-f7d5cfc9d41e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/os-volume_attachments/e908a9ac-3a6c-481d-b474-846c2a6a441b" status: 200 len: 194 microversion: 2.20 time: 0.041530 Jul 28 03:41:15.396191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 315/638] 10.222.0.16 () {60 vars in 1454 bytes} [Wed Jul 28 03:41:15 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/os-volume_attachments/e908a9ac-3a6c-481d-b474-846c2a6a441b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:41:15.461595 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-cefffd3d-135e-4f70-ab00-5f2d591e8155 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:15.462174 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-cefffd3d-135e-4f70-ab00-5f2d591e8155 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:41:15.468174 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cefffd3d-135e-4f70-ab00-5f2d591e8155 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:41:15.468630 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cefffd3d-135e-4f70-ab00-5f2d591e8155 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:41:15.469411 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cefffd3d-135e-4f70-ab00-5f2d591e8155 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:41:15.469842 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cefffd3d-135e-4f70-ab00-5f2d591e8155 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:41:15.554174 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.objects.instance [None req-cefffd3d-135e-4f70-ab00-5f2d591e8155 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lazy-loading 'services' on Instance uuid 622af242-a6fc-4f2d-9f03-61e88ee5e89f {{(pid=119155) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:41:15.618258 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-cefffd3d-135e-4f70-ab00-5f2d591e8155 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "DELETE /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/os-volume_attachments/e908a9ac-3a6c-481d-b474-846c2a6a441b" status: 202 len: 0 microversion: 2.20 time: 0.161126 Jul 28 03:41:15.618772 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 324/639] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Jul 28 03:41:15 2021] DELETE /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f/os-volume_attachments/e908a9ac-3a6c-481d-b474-846c2a6a441b => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:12.640100 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:42:12.640722 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: Wed Jul 28 03:42:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 03:42:14.957016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:42:14.957521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 03:42:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 03:42:27.380818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:42:27.381393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 03:42:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 03:42:28.742594 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 03:42:28.745972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d9659de2-2ba1-4fa4-9c74-30e5d34b8df8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:28.746495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d9659de2-2ba1-4fa4-9c74-30e5d34b8df8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:28.752758 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d9659de2-2ba1-4fa4-9c74-30e5d34b8df8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:28.753205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d9659de2-2ba1-4fa4-9c74-30e5d34b8df8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:28.753962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d9659de2-2ba1-4fa4-9c74-30e5d34b8df8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:28.754401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d9659de2-2ba1-4fa4-9c74-30e5d34b8df8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:28.777265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-d9659de2-2ba1-4fa4-9c74-30e5d34b8df8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lazy-loading 'flavor' on Instance uuid cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:42:28.846401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d9659de2-2ba1-4fa4-9c74-30e5d34b8df8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "POST /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e/action" status: 202 len: 0 microversion: 2.1 time: 0.105252 Jul 28 03:42:28.846986 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 316/640] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:42:28 2021] POST /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:42:28.857282 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-45268455-ec8a-4ffa-b520-5ee902f0f692 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:28.857985 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-45268455-ec8a-4ffa-b520-5ee902f0f692 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:28.864845 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45268455-ec8a-4ffa-b520-5ee902f0f692 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:28.865312 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45268455-ec8a-4ffa-b520-5ee902f0f692 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:28.866160 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45268455-ec8a-4ffa-b520-5ee902f0f692 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:28.866660 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-45268455-ec8a-4ffa-b520-5ee902f0f692 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:29.114757 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-45268455-ec8a-4ffa-b520-5ee902f0f692 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:29.122147 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-45268455-ec8a-4ffa-b520-5ee902f0f692 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.270677 Jul 28 03:42:29.122700 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 325/641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:28 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:30.152307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fe7faa7a-556d-44d5-beab-412003e8874b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:30.152996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fe7faa7a-556d-44d5-beab-412003e8874b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:30.162567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe7faa7a-556d-44d5-beab-412003e8874b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:30.163034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe7faa7a-556d-44d5-beab-412003e8874b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:30.163837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe7faa7a-556d-44d5-beab-412003e8874b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:30.164274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe7faa7a-556d-44d5-beab-412003e8874b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:30.167903 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59082. Jul 28 03:42:30.338465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fe7faa7a-556d-44d5-beab-412003e8874b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:30.345769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fe7faa7a-556d-44d5-beab-412003e8874b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.209279 Jul 28 03:42:30.346607 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 317/642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:30 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:31.363414 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b36e42a0-125a-450d-9b81-841e90aa7ea9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:31.364040 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b36e42a0-125a-450d-9b81-841e90aa7ea9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:31.369893 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b36e42a0-125a-450d-9b81-841e90aa7ea9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:31.370332 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b36e42a0-125a-450d-9b81-841e90aa7ea9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:31.371084 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b36e42a0-125a-450d-9b81-841e90aa7ea9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:31.371508 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b36e42a0-125a-450d-9b81-841e90aa7ea9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:31.491359 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b36e42a0-125a-450d-9b81-841e90aa7ea9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:31.498501 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b36e42a0-125a-450d-9b81-841e90aa7ea9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139346 Jul 28 03:42:31.499050 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 326/643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:31 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:32.516684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a9eba350-b17c-40a1-a946-3e84aed94774 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:32.517710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a9eba350-b17c-40a1-a946-3e84aed94774 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:32.523583 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a9eba350-b17c-40a1-a946-3e84aed94774 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:32.524070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a9eba350-b17c-40a1-a946-3e84aed94774 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:32.524836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a9eba350-b17c-40a1-a946-3e84aed94774 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:32.525268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a9eba350-b17c-40a1-a946-3e84aed94774 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:32.642541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a9eba350-b17c-40a1-a946-3e84aed94774 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:32.649752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a9eba350-b17c-40a1-a946-3e84aed94774 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136657 Jul 28 03:42:32.650320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 318/644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:32 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:33.666840 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-15c4bed6-f956-4564-a30e-3a666e041181 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:33.667438 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-15c4bed6-f956-4564-a30e-3a666e041181 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:33.673616 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-15c4bed6-f956-4564-a30e-3a666e041181 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:33.674061 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-15c4bed6-f956-4564-a30e-3a666e041181 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:33.674822 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-15c4bed6-f956-4564-a30e-3a666e041181 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:33.675245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-15c4bed6-f956-4564-a30e-3a666e041181 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:33.793751 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-15c4bed6-f956-4564-a30e-3a666e041181 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:33.801643 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-15c4bed6-f956-4564-a30e-3a666e041181 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138365 Jul 28 03:42:33.802197 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 327/645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:33 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:34.818782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4b7a43d9-c116-4ad5-a4d3-e56d7d645a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:34.819346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4b7a43d9-c116-4ad5-a4d3-e56d7d645a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:34.825077 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b7a43d9-c116-4ad5-a4d3-e56d7d645a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:34.825517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b7a43d9-c116-4ad5-a4d3-e56d7d645a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:34.826273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b7a43d9-c116-4ad5-a4d3-e56d7d645a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:34.826697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b7a43d9-c116-4ad5-a4d3-e56d7d645a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:34.948632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4b7a43d9-c116-4ad5-a4d3-e56d7d645a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:34.956183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4b7a43d9-c116-4ad5-a4d3-e56d7d645a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141124 Jul 28 03:42:34.956738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 319/646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:34 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:35.973965 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-fefce9a9-d52a-476c-9255-63b59e73f561 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:35.974564 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-fefce9a9-d52a-476c-9255-63b59e73f561 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:35.980285 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fefce9a9-d52a-476c-9255-63b59e73f561 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:35.980729 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fefce9a9-d52a-476c-9255-63b59e73f561 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:35.981481 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fefce9a9-d52a-476c-9255-63b59e73f561 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:35.981905 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-fefce9a9-d52a-476c-9255-63b59e73f561 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:36.106750 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-fefce9a9-d52a-476c-9255-63b59e73f561 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:36.114925 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-fefce9a9-d52a-476c-9255-63b59e73f561 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.145417 Jul 28 03:42:36.115474 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 328/647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:35 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:37.132088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6b8b7506-dacb-4fea-8c87-0e93a12ed3d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:37.132907 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6b8b7506-dacb-4fea-8c87-0e93a12ed3d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:37.138618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b8b7506-dacb-4fea-8c87-0e93a12ed3d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:37.139066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b8b7506-dacb-4fea-8c87-0e93a12ed3d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:37.139854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b8b7506-dacb-4fea-8c87-0e93a12ed3d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:37.140287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b8b7506-dacb-4fea-8c87-0e93a12ed3d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:37.260473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6b8b7506-dacb-4fea-8c87-0e93a12ed3d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:37.268394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6b8b7506-dacb-4fea-8c87-0e93a12ed3d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139978 Jul 28 03:42:37.268946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 320/648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:37 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:38.286221 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c1fda781-4e52-42d2-8090-2d9316d1701f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:38.286757 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c1fda781-4e52-42d2-8090-2d9316d1701f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:38.292542 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c1fda781-4e52-42d2-8090-2d9316d1701f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:38.292985 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c1fda781-4e52-42d2-8090-2d9316d1701f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:38.293749 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c1fda781-4e52-42d2-8090-2d9316d1701f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:38.294180 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c1fda781-4e52-42d2-8090-2d9316d1701f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:38.412744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c1fda781-4e52-42d2-8090-2d9316d1701f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:38.419988 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c1fda781-4e52-42d2-8090-2d9316d1701f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138264 Jul 28 03:42:38.420535 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 329/649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:38 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:39.437035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-968a5e86-a021-4fb0-9671-d3456ecbdb35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:39.437640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-968a5e86-a021-4fb0-9671-d3456ecbdb35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:39.443614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-968a5e86-a021-4fb0-9671-d3456ecbdb35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:39.444132 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-968a5e86-a021-4fb0-9671-d3456ecbdb35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:39.444933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-968a5e86-a021-4fb0-9671-d3456ecbdb35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:39.445369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-968a5e86-a021-4fb0-9671-d3456ecbdb35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:39.565496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-968a5e86-a021-4fb0-9671-d3456ecbdb35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:39.572887 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-968a5e86-a021-4fb0-9671-d3456ecbdb35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139460 Jul 28 03:42:39.573452 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 321/650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:39 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:40.591327 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-6cc24980-cbfd-40f1-ae49-831f95d44ad7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:40.591966 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-6cc24980-cbfd-40f1-ae49-831f95d44ad7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:40.598677 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6cc24980-cbfd-40f1-ae49-831f95d44ad7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:40.599126 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6cc24980-cbfd-40f1-ae49-831f95d44ad7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:40.599953 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6cc24980-cbfd-40f1-ae49-831f95d44ad7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:40.600387 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6cc24980-cbfd-40f1-ae49-831f95d44ad7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:40.722996 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-6cc24980-cbfd-40f1-ae49-831f95d44ad7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:40.730421 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-6cc24980-cbfd-40f1-ae49-831f95d44ad7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.142685 Jul 28 03:42:40.730974 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 330/651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:40 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:41.748217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e975176d-8a96-4043-a512-489dd3f3a5ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:41.748820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e975176d-8a96-4043-a512-489dd3f3a5ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:41.755637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e975176d-8a96-4043-a512-489dd3f3a5ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:41.756107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e975176d-8a96-4043-a512-489dd3f3a5ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:41.756861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e975176d-8a96-4043-a512-489dd3f3a5ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:41.757288 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e975176d-8a96-4043-a512-489dd3f3a5ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:41.878501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e975176d-8a96-4043-a512-489dd3f3a5ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:41.885623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e975176d-8a96-4043-a512-489dd3f3a5ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141067 Jul 28 03:42:41.886196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 322/652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:41 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:42.902771 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1b905b86-b0c2-4677-82f3-8abb8b14bd6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:42.903402 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1b905b86-b0c2-4677-82f3-8abb8b14bd6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:42.910150 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1b905b86-b0c2-4677-82f3-8abb8b14bd6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:42.910589 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1b905b86-b0c2-4677-82f3-8abb8b14bd6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:42.911344 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1b905b86-b0c2-4677-82f3-8abb8b14bd6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:42.911790 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1b905b86-b0c2-4677-82f3-8abb8b14bd6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:43.030024 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1b905b86-b0c2-4677-82f3-8abb8b14bd6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:43.037986 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1b905b86-b0c2-4677-82f3-8abb8b14bd6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138827 Jul 28 03:42:43.038545 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 331/653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:42 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:42:44.054278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3bdd4c4b-7ba6-40bb-93e8-d9ad9b6fb2fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:44.054807 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3bdd4c4b-7ba6-40bb-93e8-d9ad9b6fb2fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:44.060607 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c4b-7ba6-40bb-93e8-d9ad9b6fb2fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:44.061230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c4b-7ba6-40bb-93e8-d9ad9b6fb2fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:44.061990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c4b-7ba6-40bb-93e8-d9ad9b6fb2fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:44.062415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c4b-7ba6-40bb-93e8-d9ad9b6fb2fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:44.185149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3bdd4c4b-7ba6-40bb-93e8-d9ad9b6fb2fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:44.192722 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3bdd4c4b-7ba6-40bb-93e8-d9ad9b6fb2fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.142209 Jul 28 03:42:44.193271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 323/654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:44 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:45.043930 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [req-8a2f1cc8-a043-4b80-ab3a-b9213cf50634 req-931c1760-3724-4683-8cb1-f5675eb85173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e", "name": "network-vif-unplugged", "status": "completed", "tag": "fbcce620-dcf6-4f36-b99e-42b820797a20"}]} {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:45.045457 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:42:45.045457 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: warnings.warn(msg) Jul 28 03:42:45.052958 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-8a2f1cc8-a043-4b80-ab3a-b9213cf50634 req-931c1760-3724-4683-8cb1-f5675eb85173 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:45.053405 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [req-8a2f1cc8-a043-4b80-ab3a-b9213cf50634 req-931c1760-3724-4683-8cb1-f5675eb85173 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:45.064599 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.compute.server_external_events [req-8a2f1cc8-a043-4b80-ab3a-b9213cf50634 req-931c1760-3724-4683-8cb1-f5675eb85173 service nova] Creating event network-vif-unplugged:fbcce620-dcf6-4f36-b99e-42b820797a20 for instance cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e on hv-cinder-73306 Jul 28 03:42:45.069685 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [req-8a2f1cc8-a043-4b80-ab3a-b9213cf50634 req-931c1760-3724-4683-8cb1-f5675eb85173 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086380 Jul 28 03:42:45.070265 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 332/655] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:42:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:45.209818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-25cc52b0-e8f2-4983-a1b1-2516a116f64d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:45.210356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-25cc52b0-e8f2-4983-a1b1-2516a116f64d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:45.216093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25cc52b0-e8f2-4983-a1b1-2516a116f64d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:45.216537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25cc52b0-e8f2-4983-a1b1-2516a116f64d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:45.217287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25cc52b0-e8f2-4983-a1b1-2516a116f64d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:45.217710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25cc52b0-e8f2-4983-a1b1-2516a116f64d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:45.337098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-25cc52b0-e8f2-4983-a1b1-2516a116f64d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:45.344204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-25cc52b0-e8f2-4983-a1b1-2516a116f64d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138114 Jul 28 03:42:45.344752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 324/656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:45 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:46.362541 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f159c07b-3b9e-411b-a85b-df5066af51a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:46.363236 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f159c07b-3b9e-411b-a85b-df5066af51a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:46.369953 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f159c07b-3b9e-411b-a85b-df5066af51a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:46.370393 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f159c07b-3b9e-411b-a85b-df5066af51a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:46.371148 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f159c07b-3b9e-411b-a85b-df5066af51a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:46.371576 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f159c07b-3b9e-411b-a85b-df5066af51a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:46.495122 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f159c07b-3b9e-411b-a85b-df5066af51a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:46.503021 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f159c07b-3b9e-411b-a85b-df5066af51a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.143803 Jul 28 03:42:46.503606 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 333/657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:46 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:47.521234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4656d5f8-9e8c-4e95-ab29-9a4402410faf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:47.521908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4656d5f8-9e8c-4e95-ab29-9a4402410faf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:47.527912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4656d5f8-9e8c-4e95-ab29-9a4402410faf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:47.528363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4656d5f8-9e8c-4e95-ab29-9a4402410faf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:47.529134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4656d5f8-9e8c-4e95-ab29-9a4402410faf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:47.529566 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4656d5f8-9e8c-4e95-ab29-9a4402410faf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:47.651502 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4656d5f8-9e8c-4e95-ab29-9a4402410faf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:47.658957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4656d5f8-9e8c-4e95-ab29-9a4402410faf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.142219 Jul 28 03:42:47.659916 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 325/658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:47 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:48.677235 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-745a16b4-3e57-47fb-bacc-67601952fef1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:48.677826 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-745a16b4-3e57-47fb-bacc-67601952fef1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:48.683667 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-745a16b4-3e57-47fb-bacc-67601952fef1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:48.684134 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-745a16b4-3e57-47fb-bacc-67601952fef1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:48.684888 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-745a16b4-3e57-47fb-bacc-67601952fef1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:48.685310 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-745a16b4-3e57-47fb-bacc-67601952fef1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:48.804792 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-745a16b4-3e57-47fb-bacc-67601952fef1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:48.811994 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-745a16b4-3e57-47fb-bacc-67601952fef1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138947 Jul 28 03:42:48.812554 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 334/659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:48 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:49.829229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e59b4ced-f916-4bd1-a748-c63d0d5a04ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:49.829838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e59b4ced-f916-4bd1-a748-c63d0d5a04ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:49.836557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e59b4ced-f916-4bd1-a748-c63d0d5a04ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:49.837006 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e59b4ced-f916-4bd1-a748-c63d0d5a04ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:49.837776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e59b4ced-f916-4bd1-a748-c63d0d5a04ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:49.838205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e59b4ced-f916-4bd1-a748-c63d0d5a04ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:49.956848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e59b4ced-f916-4bd1-a748-c63d0d5a04ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:49.963993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e59b4ced-f916-4bd1-a748-c63d0d5a04ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138476 Jul 28 03:42:49.964550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 326/660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:49 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:50.981343 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0f9fed57-a5fc-4319-a3f5-d26241103788 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:50.981941 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0f9fed57-a5fc-4319-a3f5-d26241103788 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:50.988418 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f9fed57-a5fc-4319-a3f5-d26241103788 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:50.988859 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f9fed57-a5fc-4319-a3f5-d26241103788 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:50.989624 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f9fed57-a5fc-4319-a3f5-d26241103788 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:50.990048 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f9fed57-a5fc-4319-a3f5-d26241103788 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:51.112224 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0f9fed57-a5fc-4319-a3f5-d26241103788 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:51.119403 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0f9fed57-a5fc-4319-a3f5-d26241103788 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141671 Jul 28 03:42:51.120207 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 335/661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:50 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:52.138056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f934c2d2-9e60-41bc-a0f8-595f23606bb0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:52.138661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f934c2d2-9e60-41bc-a0f8-595f23606bb0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:52.145353 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f934c2d2-9e60-41bc-a0f8-595f23606bb0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:52.145792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f934c2d2-9e60-41bc-a0f8-595f23606bb0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:52.146801 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f934c2d2-9e60-41bc-a0f8-595f23606bb0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:52.146981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f934c2d2-9e60-41bc-a0f8-595f23606bb0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:52.265211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f934c2d2-9e60-41bc-a0f8-595f23606bb0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:52.272828 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f934c2d2-9e60-41bc-a0f8-595f23606bb0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138448 Jul 28 03:42:52.273395 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 327/662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:52 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:53.289991 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0f979582-6454-45f4-8565-381fb482aee5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:53.290595 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0f979582-6454-45f4-8565-381fb482aee5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:53.296499 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f979582-6454-45f4-8565-381fb482aee5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:53.296949 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f979582-6454-45f4-8565-381fb482aee5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:53.297745 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f979582-6454-45f4-8565-381fb482aee5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:53.298181 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0f979582-6454-45f4-8565-381fb482aee5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:53.426186 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0f979582-6454-45f4-8565-381fb482aee5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:53.433865 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0f979582-6454-45f4-8565-381fb482aee5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.147549 Jul 28 03:42:53.434416 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 336/663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:53 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:54.451873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-310c219e-eb15-43f6-820d-6ea96cf0e90a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:54.452413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-310c219e-eb15-43f6-820d-6ea96cf0e90a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:54.458687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-310c219e-eb15-43f6-820d-6ea96cf0e90a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:54.459136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-310c219e-eb15-43f6-820d-6ea96cf0e90a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:54.459937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-310c219e-eb15-43f6-820d-6ea96cf0e90a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:54.460376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-310c219e-eb15-43f6-820d-6ea96cf0e90a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:54.580408 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-310c219e-eb15-43f6-820d-6ea96cf0e90a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:54.588266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-310c219e-eb15-43f6-820d-6ea96cf0e90a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.140144 Jul 28 03:42:54.588819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 328/664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:54 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:55.605784 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ccebda92-7dc6-44ab-befb-603bc9a50088 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:55.606391 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ccebda92-7dc6-44ab-befb-603bc9a50088 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:55.612797 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ccebda92-7dc6-44ab-befb-603bc9a50088 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:55.613232 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ccebda92-7dc6-44ab-befb-603bc9a50088 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:55.613994 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ccebda92-7dc6-44ab-befb-603bc9a50088 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:55.614418 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ccebda92-7dc6-44ab-befb-603bc9a50088 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:55.732844 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ccebda92-7dc6-44ab-befb-603bc9a50088 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:55.740452 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ccebda92-7dc6-44ab-befb-603bc9a50088 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138283 Jul 28 03:42:55.740997 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 337/665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:55 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:56.757371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-222e403f-aff9-4463-8562-0c6d215799e3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:56.758009 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-222e403f-aff9-4463-8562-0c6d215799e3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:56.763750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222e403f-aff9-4463-8562-0c6d215799e3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:56.764203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222e403f-aff9-4463-8562-0c6d215799e3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:56.764966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222e403f-aff9-4463-8562-0c6d215799e3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:56.765395 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222e403f-aff9-4463-8562-0c6d215799e3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:56.883599 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-222e403f-aff9-4463-8562-0c6d215799e3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:56.890812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-222e403f-aff9-4463-8562-0c6d215799e3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137129 Jul 28 03:42:56.891371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 329/666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:56 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:57.909334 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-cf06b3cf-6b32-42ff-b45e-79ad6279c8e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:57.909947 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-cf06b3cf-6b32-42ff-b45e-79ad6279c8e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:57.915747 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cf06b3cf-6b32-42ff-b45e-79ad6279c8e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:57.916196 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cf06b3cf-6b32-42ff-b45e-79ad6279c8e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:57.916956 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cf06b3cf-6b32-42ff-b45e-79ad6279c8e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:57.917387 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-cf06b3cf-6b32-42ff-b45e-79ad6279c8e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:58.034999 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-cf06b3cf-6b32-42ff-b45e-79ad6279c8e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:58.042222 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-cf06b3cf-6b32-42ff-b45e-79ad6279c8e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136674 Jul 28 03:42:58.042780 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 338/667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:57 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:59.059481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-372be4de-23d8-4986-9999-bbe12a265f64 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:59.060225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-372be4de-23d8-4986-9999-bbe12a265f64 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:42:59.066767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-372be4de-23d8-4986-9999-bbe12a265f64 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:59.067215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-372be4de-23d8-4986-9999-bbe12a265f64 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:59.068021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-372be4de-23d8-4986-9999-bbe12a265f64 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:42:59.068460 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-372be4de-23d8-4986-9999-bbe12a265f64 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:42:59.187868 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-372be4de-23d8-4986-9999-bbe12a265f64 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:59.196157 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-372be4de-23d8-4986-9999-bbe12a265f64 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.140352 Jul 28 03:42:59.196725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 330/668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:42:59 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:00.212972 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-4af4609b-4b0f-4f69-a7df-e9805c09f187 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:00.213578 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-4af4609b-4b0f-4f69-a7df-e9805c09f187 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:00.219434 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4af4609b-4b0f-4f69-a7df-e9805c09f187 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:00.219921 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4af4609b-4b0f-4f69-a7df-e9805c09f187 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:00.220680 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4af4609b-4b0f-4f69-a7df-e9805c09f187 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:00.221883 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4af4609b-4b0f-4f69-a7df-e9805c09f187 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:00.344584 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-4af4609b-4b0f-4f69-a7df-e9805c09f187 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:00.352369 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-4af4609b-4b0f-4f69-a7df-e9805c09f187 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.143070 Jul 28 03:43:00.352927 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 339/669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:00 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:01.369557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a21c4ae3-1fed-4d88-a790-af8329f84a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:01.370168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a21c4ae3-1fed-4d88-a790-af8329f84a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:01.376168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a21c4ae3-1fed-4d88-a790-af8329f84a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:01.376571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a21c4ae3-1fed-4d88-a790-af8329f84a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:01.377423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a21c4ae3-1fed-4d88-a790-af8329f84a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:01.377896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a21c4ae3-1fed-4d88-a790-af8329f84a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:01.497772 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a21c4ae3-1fed-4d88-a790-af8329f84a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:01.505651 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a21c4ae3-1fed-4d88-a790-af8329f84a9b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139779 Jul 28 03:43:01.506217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 331/670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:01 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:02.523271 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-54da52a7-4bcd-4d1d-a073-547e106bb683 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:02.523823 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-54da52a7-4bcd-4d1d-a073-547e106bb683 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:02.529581 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-54da52a7-4bcd-4d1d-a073-547e106bb683 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:02.530052 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-54da52a7-4bcd-4d1d-a073-547e106bb683 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:02.530813 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-54da52a7-4bcd-4d1d-a073-547e106bb683 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:02.531247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-54da52a7-4bcd-4d1d-a073-547e106bb683 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:02.649931 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-54da52a7-4bcd-4d1d-a073-547e106bb683 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:02.657117 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-54da52a7-4bcd-4d1d-a073-547e106bb683 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137625 Jul 28 03:43:02.657672 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 340/671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:02 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:03.674117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3982f9cb-ac7d-4162-8ab4-eccf7e9846ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:03.675404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3982f9cb-ac7d-4162-8ab4-eccf7e9846ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:03.681450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3982f9cb-ac7d-4162-8ab4-eccf7e9846ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:03.681901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3982f9cb-ac7d-4162-8ab4-eccf7e9846ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:03.682679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3982f9cb-ac7d-4162-8ab4-eccf7e9846ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:03.683107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3982f9cb-ac7d-4162-8ab4-eccf7e9846ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:03.804480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3982f9cb-ac7d-4162-8ab4-eccf7e9846ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:03.811592 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3982f9cb-ac7d-4162-8ab4-eccf7e9846ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141263 Jul 28 03:43:03.812175 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 332/672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:03 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:04.829254 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-38c550fb-0dcc-431d-af57-55adc1ce8997 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:04.829860 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-38c550fb-0dcc-431d-af57-55adc1ce8997 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:04.836944 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-38c550fb-0dcc-431d-af57-55adc1ce8997 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:04.837391 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-38c550fb-0dcc-431d-af57-55adc1ce8997 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:04.838155 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-38c550fb-0dcc-431d-af57-55adc1ce8997 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:04.838588 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-38c550fb-0dcc-431d-af57-55adc1ce8997 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:04.956915 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-38c550fb-0dcc-431d-af57-55adc1ce8997 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:04.964052 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-38c550fb-0dcc-431d-af57-55adc1ce8997 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138428 Jul 28 03:43:04.964607 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 341/673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:04 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:05.981487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f5fdf37e-98c1-42d7-8621-ca7e1d547bfb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:05.982033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f5fdf37e-98c1-42d7-8621-ca7e1d547bfb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:05.988350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5fdf37e-98c1-42d7-8621-ca7e1d547bfb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:05.988796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5fdf37e-98c1-42d7-8621-ca7e1d547bfb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:05.989557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5fdf37e-98c1-42d7-8621-ca7e1d547bfb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:05.989988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5fdf37e-98c1-42d7-8621-ca7e1d547bfb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:06.108043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f5fdf37e-98c1-42d7-8621-ca7e1d547bfb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:06.115861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f5fdf37e-98c1-42d7-8621-ca7e1d547bfb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138105 Jul 28 03:43:06.116415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 333/674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:05 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:07.133734 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-9ce247ce-3d05-42d5-af1b-0c67593334c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:07.134360 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-9ce247ce-3d05-42d5-af1b-0c67593334c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:07.140220 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9ce247ce-3d05-42d5-af1b-0c67593334c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:07.140672 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9ce247ce-3d05-42d5-af1b-0c67593334c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:07.141441 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9ce247ce-3d05-42d5-af1b-0c67593334c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:07.141878 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9ce247ce-3d05-42d5-af1b-0c67593334c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:07.265965 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-9ce247ce-3d05-42d5-af1b-0c67593334c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:07.273271 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-9ce247ce-3d05-42d5-af1b-0c67593334c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.143583 Jul 28 03:43:07.273828 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 342/675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:07 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:08.290476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ad8ebd70-f0a1-4113-8e09-afc62fc52f49 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:08.291085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ad8ebd70-f0a1-4113-8e09-afc62fc52f49 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:08.296968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad8ebd70-f0a1-4113-8e09-afc62fc52f49 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:08.297418 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad8ebd70-f0a1-4113-8e09-afc62fc52f49 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:08.298178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad8ebd70-f0a1-4113-8e09-afc62fc52f49 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:08.298612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad8ebd70-f0a1-4113-8e09-afc62fc52f49 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:08.421349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ad8ebd70-f0a1-4113-8e09-afc62fc52f49 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:08.428553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ad8ebd70-f0a1-4113-8e09-afc62fc52f49 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141772 Jul 28 03:43:08.429106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 334/676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:08 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:09.445633 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-0383b1bc-d48f-4212-a359-c4e049e93810 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:09.446149 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-0383b1bc-d48f-4212-a359-c4e049e93810 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:09.451995 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0383b1bc-d48f-4212-a359-c4e049e93810 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:09.452442 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0383b1bc-d48f-4212-a359-c4e049e93810 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:09.453204 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0383b1bc-d48f-4212-a359-c4e049e93810 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:09.453635 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-0383b1bc-d48f-4212-a359-c4e049e93810 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:09.571155 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-0383b1bc-d48f-4212-a359-c4e049e93810 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:09.578283 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-0383b1bc-d48f-4212-a359-c4e049e93810 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136488 Jul 28 03:43:09.578831 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 343/677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:09 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:10.596900 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-490974b5-2c01-4a6d-8165-dab9dae76297 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:10.597671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-490974b5-2c01-4a6d-8165-dab9dae76297 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:10.603477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-490974b5-2c01-4a6d-8165-dab9dae76297 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:10.603947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-490974b5-2c01-4a6d-8165-dab9dae76297 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:10.604711 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-490974b5-2c01-4a6d-8165-dab9dae76297 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:10.605141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-490974b5-2c01-4a6d-8165-dab9dae76297 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:10.722784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-490974b5-2c01-4a6d-8165-dab9dae76297 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:10.729879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-490974b5-2c01-4a6d-8165-dab9dae76297 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137462 Jul 28 03:43:10.730426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 335/678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:10 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:11.747419 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-81693cd7-26b8-428e-902c-de23ed4505fa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:11.748058 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-81693cd7-26b8-428e-902c-de23ed4505fa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:11.754127 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-81693cd7-26b8-428e-902c-de23ed4505fa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:11.754575 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-81693cd7-26b8-428e-902c-de23ed4505fa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:11.755338 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-81693cd7-26b8-428e-902c-de23ed4505fa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:11.755804 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-81693cd7-26b8-428e-902c-de23ed4505fa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:11.872361 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-81693cd7-26b8-428e-902c-de23ed4505fa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:11.879999 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-81693cd7-26b8-428e-902c-de23ed4505fa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136191 Jul 28 03:43:11.880569 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 344/679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:11 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:12.896820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bf9bf150-ed67-46eb-8022-7160af8ae536 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:12.897441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bf9bf150-ed67-46eb-8022-7160af8ae536 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:12.903333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf9bf150-ed67-46eb-8022-7160af8ae536 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:12.903821 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf9bf150-ed67-46eb-8022-7160af8ae536 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:12.904597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf9bf150-ed67-46eb-8022-7160af8ae536 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:12.905035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf9bf150-ed67-46eb-8022-7160af8ae536 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:13.023376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bf9bf150-ed67-46eb-8022-7160af8ae536 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:13.030587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bf9bf150-ed67-46eb-8022-7160af8ae536 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137418 Jul 28 03:43:13.031146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 336/680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:12 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:14.048304 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-379f9307-b3de-46f8-921f-dd1bedeff993 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:14.048839 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-379f9307-b3de-46f8-921f-dd1bedeff993 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:14.055247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-379f9307-b3de-46f8-921f-dd1bedeff993 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:14.055701 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-379f9307-b3de-46f8-921f-dd1bedeff993 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:14.056491 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-379f9307-b3de-46f8-921f-dd1bedeff993 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:14.056920 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-379f9307-b3de-46f8-921f-dd1bedeff993 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:14.179593 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-379f9307-b3de-46f8-921f-dd1bedeff993 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:14.186824 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-379f9307-b3de-46f8-921f-dd1bedeff993 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.142267 Jul 28 03:43:14.187386 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 345/681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:14 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:15.204308 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-959ef143-baa8-40f5-86f1-8fcd304096b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:15.204912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-959ef143-baa8-40f5-86f1-8fcd304096b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:15.211663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-959ef143-baa8-40f5-86f1-8fcd304096b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:15.212130 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-959ef143-baa8-40f5-86f1-8fcd304096b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:15.212925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-959ef143-baa8-40f5-86f1-8fcd304096b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:15.213385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-959ef143-baa8-40f5-86f1-8fcd304096b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:15.334844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-959ef143-baa8-40f5-86f1-8fcd304096b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:15.341965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-959ef143-baa8-40f5-86f1-8fcd304096b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141612 Jul 28 03:43:15.342521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 337/682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:15 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:16.359126 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-834b4002-32ed-4af5-b8c4-17807a1af130 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:16.359733 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-834b4002-32ed-4af5-b8c4-17807a1af130 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:16.365626 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-834b4002-32ed-4af5-b8c4-17807a1af130 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:16.366086 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-834b4002-32ed-4af5-b8c4-17807a1af130 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:16.366827 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-834b4002-32ed-4af5-b8c4-17807a1af130 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:16.367259 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-834b4002-32ed-4af5-b8c4-17807a1af130 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:16.484512 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-834b4002-32ed-4af5-b8c4-17807a1af130 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:16.491723 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-834b4002-32ed-4af5-b8c4-17807a1af130 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136213 Jul 28 03:43:16.492286 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 346/683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:16 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:17.508801 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8884ac95-bec0-44cb-8a85-fdb9f6ec9741 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:17.509349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8884ac95-bec0-44cb-8a85-fdb9f6ec9741 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:17.515078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8884ac95-bec0-44cb-8a85-fdb9f6ec9741 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:17.515524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8884ac95-bec0-44cb-8a85-fdb9f6ec9741 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:17.516317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8884ac95-bec0-44cb-8a85-fdb9f6ec9741 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:17.516755 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8884ac95-bec0-44cb-8a85-fdb9f6ec9741 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:17.635233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8884ac95-bec0-44cb-8a85-fdb9f6ec9741 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:17.642452 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8884ac95-bec0-44cb-8a85-fdb9f6ec9741 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137437 Jul 28 03:43:17.643490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 338/684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:17 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:18.660064 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-6111a01e-e7c6-45bc-a302-bd47d4ce92c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:18.660699 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-6111a01e-e7c6-45bc-a302-bd47d4ce92c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:18.666555 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6111a01e-e7c6-45bc-a302-bd47d4ce92c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:18.667002 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6111a01e-e7c6-45bc-a302-bd47d4ce92c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:18.667792 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6111a01e-e7c6-45bc-a302-bd47d4ce92c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:18.668227 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6111a01e-e7c6-45bc-a302-bd47d4ce92c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:18.787684 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-6111a01e-e7c6-45bc-a302-bd47d4ce92c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:18.794881 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-6111a01e-e7c6-45bc-a302-bd47d4ce92c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138646 Jul 28 03:43:18.795439 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 347/685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:18 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:19.811925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4a859362-c82d-4167-a83c-5544ea3ad999 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:19.812537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4a859362-c82d-4167-a83c-5544ea3ad999 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:19.818508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a859362-c82d-4167-a83c-5544ea3ad999 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:19.818953 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a859362-c82d-4167-a83c-5544ea3ad999 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:19.819731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a859362-c82d-4167-a83c-5544ea3ad999 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:19.820173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a859362-c82d-4167-a83c-5544ea3ad999 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:19.937415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4a859362-c82d-4167-a83c-5544ea3ad999 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:19.944671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4a859362-c82d-4167-a83c-5544ea3ad999 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136485 Jul 28 03:43:19.945226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 339/686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:19 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:20.961273 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2a7ae60d-2354-4ca8-aa35-97d552e6b969 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:20.961884 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2a7ae60d-2354-4ca8-aa35-97d552e6b969 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:20.967673 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2a7ae60d-2354-4ca8-aa35-97d552e6b969 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:20.968149 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2a7ae60d-2354-4ca8-aa35-97d552e6b969 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:20.968904 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2a7ae60d-2354-4ca8-aa35-97d552e6b969 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:20.969334 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2a7ae60d-2354-4ca8-aa35-97d552e6b969 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:21.091290 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-2a7ae60d-2354-4ca8-aa35-97d552e6b969 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:21.099374 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2a7ae60d-2354-4ca8-aa35-97d552e6b969 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141702 Jul 28 03:43:21.100043 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 348/687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:20 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:22.117673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4f851cc4-817e-430a-9cfd-6eef5833ff25 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:22.118316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4f851cc4-817e-430a-9cfd-6eef5833ff25 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:22.124198 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4f851cc4-817e-430a-9cfd-6eef5833ff25 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:22.124898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4f851cc4-817e-430a-9cfd-6eef5833ff25 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:22.125406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4f851cc4-817e-430a-9cfd-6eef5833ff25 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:22.125841 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4f851cc4-817e-430a-9cfd-6eef5833ff25 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:22.249359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4f851cc4-817e-430a-9cfd-6eef5833ff25 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:22.257209 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4f851cc4-817e-430a-9cfd-6eef5833ff25 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.143203 Jul 28 03:43:22.257771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 340/688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:22 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:23.273860 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-9a7e445c-fc3b-4c48-adb3-7f3a59d91dc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:23.274464 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-9a7e445c-fc3b-4c48-adb3-7f3a59d91dc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:23.280233 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9a7e445c-fc3b-4c48-adb3-7f3a59d91dc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:23.280679 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9a7e445c-fc3b-4c48-adb3-7f3a59d91dc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:23.281439 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9a7e445c-fc3b-4c48-adb3-7f3a59d91dc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:23.281871 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-9a7e445c-fc3b-4c48-adb3-7f3a59d91dc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:23.405681 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-9a7e445c-fc3b-4c48-adb3-7f3a59d91dc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:23.414030 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-9a7e445c-fc3b-4c48-adb3-7f3a59d91dc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.144141 Jul 28 03:43:23.414669 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 349/689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:23 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:24.431309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c69dc8df-71cd-4b6a-8ca9-041d747f3fd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:24.431877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c69dc8df-71cd-4b6a-8ca9-041d747f3fd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:24.437717 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c69dc8df-71cd-4b6a-8ca9-041d747f3fd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:24.438170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c69dc8df-71cd-4b6a-8ca9-041d747f3fd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:24.438934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c69dc8df-71cd-4b6a-8ca9-041d747f3fd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:24.439372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c69dc8df-71cd-4b6a-8ca9-041d747f3fd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:24.557934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c69dc8df-71cd-4b6a-8ca9-041d747f3fd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:24.565104 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c69dc8df-71cd-4b6a-8ca9-041d747f3fd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137504 Jul 28 03:43:24.565667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 341/690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:24 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:25.582161 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e1d2d717-e5f7-4df5-afd9-b6daf8fce927 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:25.583383 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e1d2d717-e5f7-4df5-afd9-b6daf8fce927 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:25.589247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e1d2d717-e5f7-4df5-afd9-b6daf8fce927 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:25.589702 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e1d2d717-e5f7-4df5-afd9-b6daf8fce927 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:25.590470 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e1d2d717-e5f7-4df5-afd9-b6daf8fce927 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:25.590905 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e1d2d717-e5f7-4df5-afd9-b6daf8fce927 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:25.712561 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e1d2d717-e5f7-4df5-afd9-b6daf8fce927 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:25.719908 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e1d2d717-e5f7-4df5-afd9-b6daf8fce927 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141454 Jul 28 03:43:25.720468 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 350/691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:25 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:26.737197 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bdc15a79-123c-48e7-9164-f46a25c7984c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:26.737813 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bdc15a79-123c-48e7-9164-f46a25c7984c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:26.744127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bdc15a79-123c-48e7-9164-f46a25c7984c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:26.744575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bdc15a79-123c-48e7-9164-f46a25c7984c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:26.745337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bdc15a79-123c-48e7-9164-f46a25c7984c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:26.745804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bdc15a79-123c-48e7-9164-f46a25c7984c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:26.863472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bdc15a79-123c-48e7-9164-f46a25c7984c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:26.871202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bdc15a79-123c-48e7-9164-f46a25c7984c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137659 Jul 28 03:43:26.871848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 342/692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:26 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:27.888822 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d42452b6-dac0-45a7-bb15-7de3eab0681e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:27.889416 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d42452b6-dac0-45a7-bb15-7de3eab0681e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:27.895167 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d42452b6-dac0-45a7-bb15-7de3eab0681e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:27.895671 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d42452b6-dac0-45a7-bb15-7de3eab0681e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:27.896563 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d42452b6-dac0-45a7-bb15-7de3eab0681e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:27.897012 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d42452b6-dac0-45a7-bb15-7de3eab0681e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:28.093865 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d42452b6-dac0-45a7-bb15-7de3eab0681e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:28.101934 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d42452b6-dac0-45a7-bb15-7de3eab0681e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.216752 Jul 28 03:43:28.102486 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 351/693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:27 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:29.118633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ccebad9a-1a61-480b-8395-2b0893da5d12 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:29.119246 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ccebad9a-1a61-480b-8395-2b0893da5d12 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:29.125039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ccebad9a-1a61-480b-8395-2b0893da5d12 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:29.125488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ccebad9a-1a61-480b-8395-2b0893da5d12 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:29.126256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ccebad9a-1a61-480b-8395-2b0893da5d12 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:29.126721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ccebad9a-1a61-480b-8395-2b0893da5d12 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:29.250526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ccebad9a-1a61-480b-8395-2b0893da5d12 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:29.258381 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ccebad9a-1a61-480b-8395-2b0893da5d12 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.143475 Jul 28 03:43:29.258937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 343/694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:29 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:30.275272 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e811364c-75fb-41f2-ad89-e461ed115436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:30.275934 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e811364c-75fb-41f2-ad89-e461ed115436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:30.281694 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e811364c-75fb-41f2-ad89-e461ed115436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:30.282129 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e811364c-75fb-41f2-ad89-e461ed115436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:30.282879 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e811364c-75fb-41f2-ad89-e461ed115436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:30.283303 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e811364c-75fb-41f2-ad89-e461ed115436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:30.405694 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e811364c-75fb-41f2-ad89-e461ed115436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:30.413890 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e811364c-75fb-41f2-ad89-e461ed115436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.142289 Jul 28 03:43:30.414446 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 352/695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:30 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:31.431252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-255e20b5-9c04-4724-9b5c-4a155eab0ac1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:31.431861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-255e20b5-9c04-4724-9b5c-4a155eab0ac1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:31.437815 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-255e20b5-9c04-4724-9b5c-4a155eab0ac1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:31.438261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-255e20b5-9c04-4724-9b5c-4a155eab0ac1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:31.439022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-255e20b5-9c04-4724-9b5c-4a155eab0ac1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:31.439454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-255e20b5-9c04-4724-9b5c-4a155eab0ac1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:31.560427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-255e20b5-9c04-4724-9b5c-4a155eab0ac1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:31.567855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-255e20b5-9c04-4724-9b5c-4a155eab0ac1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.140124 Jul 28 03:43:31.568621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 344/696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:31 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:32.584629 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-1918eada-c115-449d-a545-fc2bb2de0dc9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:32.585210 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-1918eada-c115-449d-a545-fc2bb2de0dc9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:32.591081 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1918eada-c115-449d-a545-fc2bb2de0dc9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:32.591531 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1918eada-c115-449d-a545-fc2bb2de0dc9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:32.592336 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1918eada-c115-449d-a545-fc2bb2de0dc9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:32.592771 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-1918eada-c115-449d-a545-fc2bb2de0dc9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:32.714346 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-1918eada-c115-449d-a545-fc2bb2de0dc9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:32.721854 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-1918eada-c115-449d-a545-fc2bb2de0dc9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141322 Jul 28 03:43:32.722418 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 353/697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:32 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:33.738013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ea476dda-34c4-4e4b-bdcb-c94207293f19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:33.738620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ea476dda-34c4-4e4b-bdcb-c94207293f19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:33.745191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea476dda-34c4-4e4b-bdcb-c94207293f19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:33.745630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea476dda-34c4-4e4b-bdcb-c94207293f19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:33.746394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea476dda-34c4-4e4b-bdcb-c94207293f19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:33.746821 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea476dda-34c4-4e4b-bdcb-c94207293f19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:33.866063 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ea476dda-34c4-4e4b-bdcb-c94207293f19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:33.873194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ea476dda-34c4-4e4b-bdcb-c94207293f19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138816 Jul 28 03:43:33.873741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 345/698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:33 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:34.890159 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b8453b5b-b7c3-4207-86b3-4d3da1c33c58 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:34.890766 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b8453b5b-b7c3-4207-86b3-4d3da1c33c58 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:34.896689 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b8453b5b-b7c3-4207-86b3-4d3da1c33c58 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:34.897137 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b8453b5b-b7c3-4207-86b3-4d3da1c33c58 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:34.897901 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b8453b5b-b7c3-4207-86b3-4d3da1c33c58 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:34.898327 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b8453b5b-b7c3-4207-86b3-4d3da1c33c58 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:35.015342 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b8453b5b-b7c3-4207-86b3-4d3da1c33c58 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:35.022571 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b8453b5b-b7c3-4207-86b3-4d3da1c33c58 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136030 Jul 28 03:43:35.023123 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 354/699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:34 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:36.040342 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-db243ac7-a6b5-4536-92f2-75eda603d984 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:36.040880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-db243ac7-a6b5-4536-92f2-75eda603d984 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:36.046631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db243ac7-a6b5-4536-92f2-75eda603d984 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:36.047072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db243ac7-a6b5-4536-92f2-75eda603d984 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:36.047855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db243ac7-a6b5-4536-92f2-75eda603d984 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:36.048287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db243ac7-a6b5-4536-92f2-75eda603d984 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:36.172243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-db243ac7-a6b5-4536-92f2-75eda603d984 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:36.180210 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-db243ac7-a6b5-4536-92f2-75eda603d984 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.144459 Jul 28 03:43:36.180769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 346/700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:36 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:37.197777 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8100f1ac-eca9-40d7-853e-d90397bf07ba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:37.198382 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8100f1ac-eca9-40d7-853e-d90397bf07ba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:37.204213 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8100f1ac-eca9-40d7-853e-d90397bf07ba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:37.204656 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8100f1ac-eca9-40d7-853e-d90397bf07ba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:37.205417 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8100f1ac-eca9-40d7-853e-d90397bf07ba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:37.205857 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8100f1ac-eca9-40d7-853e-d90397bf07ba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:37.324475 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-8100f1ac-eca9-40d7-853e-d90397bf07ba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:37.331666 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8100f1ac-eca9-40d7-853e-d90397bf07ba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137522 Jul 28 03:43:37.332242 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 355/701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:37 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:38.348999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1586c71e-fb49-4ef1-adc3-a4ebd8846802 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:38.349619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1586c71e-fb49-4ef1-adc3-a4ebd8846802 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:38.355401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1586c71e-fb49-4ef1-adc3-a4ebd8846802 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:38.355899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1586c71e-fb49-4ef1-adc3-a4ebd8846802 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:38.356672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1586c71e-fb49-4ef1-adc3-a4ebd8846802 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:38.357108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1586c71e-fb49-4ef1-adc3-a4ebd8846802 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:38.475775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1586c71e-fb49-4ef1-adc3-a4ebd8846802 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:38.483241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1586c71e-fb49-4ef1-adc3-a4ebd8846802 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138379 Jul 28 03:43:38.483811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 347/702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:38 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:39.501150 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-adb564b2-a1d9-4f5e-8f39-7b738d55551d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:39.501680 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-adb564b2-a1d9-4f5e-8f39-7b738d55551d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:39.507513 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-adb564b2-a1d9-4f5e-8f39-7b738d55551d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:39.507996 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-adb564b2-a1d9-4f5e-8f39-7b738d55551d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:39.508761 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-adb564b2-a1d9-4f5e-8f39-7b738d55551d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:39.509194 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-adb564b2-a1d9-4f5e-8f39-7b738d55551d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:39.631309 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-adb564b2-a1d9-4f5e-8f39-7b738d55551d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:39.638611 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-adb564b2-a1d9-4f5e-8f39-7b738d55551d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141249 Jul 28 03:43:39.639203 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 356/703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:39 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:40.656227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cb276e27-c668-4d20-b7aa-9a711271a3c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:40.656863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cb276e27-c668-4d20-b7aa-9a711271a3c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:40.663316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb276e27-c668-4d20-b7aa-9a711271a3c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:40.663779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb276e27-c668-4d20-b7aa-9a711271a3c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:40.664539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb276e27-c668-4d20-b7aa-9a711271a3c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:40.664967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb276e27-c668-4d20-b7aa-9a711271a3c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:40.781779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cb276e27-c668-4d20-b7aa-9a711271a3c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:40.789632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cb276e27-c668-4d20-b7aa-9a711271a3c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137045 Jul 28 03:43:40.790186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 348/704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:40 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:41.806824 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-37244616-23ea-48ba-ae98-024172972979 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:41.807463 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-37244616-23ea-48ba-ae98-024172972979 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:41.813316 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-37244616-23ea-48ba-ae98-024172972979 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:41.813757 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-37244616-23ea-48ba-ae98-024172972979 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:41.814544 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-37244616-23ea-48ba-ae98-024172972979 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:41.814974 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-37244616-23ea-48ba-ae98-024172972979 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:41.933968 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-37244616-23ea-48ba-ae98-024172972979 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:41.941209 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-37244616-23ea-48ba-ae98-024172972979 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138067 Jul 28 03:43:41.942293 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 357/705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:41 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:42.958913 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5e2bc85c-7083-41ad-9687-155536c9c53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:42.959520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5e2bc85c-7083-41ad-9687-155536c9c53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:42.965351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e2bc85c-7083-41ad-9687-155536c9c53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:42.965793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e2bc85c-7083-41ad-9687-155536c9c53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:42.966547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e2bc85c-7083-41ad-9687-155536c9c53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:42.966976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e2bc85c-7083-41ad-9687-155536c9c53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:43.088463 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5e2bc85c-7083-41ad-9687-155536c9c53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:43.095680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5e2bc85c-7083-41ad-9687-155536c9c53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.140602 Jul 28 03:43:43.096259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 349/706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:42 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:44.114151 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-17455fcb-5449-456f-aa65-a68fcbb76b87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:44.114781 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-17455fcb-5449-456f-aa65-a68fcbb76b87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:44.120598 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-17455fcb-5449-456f-aa65-a68fcbb76b87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:44.121044 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-17455fcb-5449-456f-aa65-a68fcbb76b87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:44.121815 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-17455fcb-5449-456f-aa65-a68fcbb76b87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:44.122245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-17455fcb-5449-456f-aa65-a68fcbb76b87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:44.242350 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-17455fcb-5449-456f-aa65-a68fcbb76b87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:44.249658 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-17455fcb-5449-456f-aa65-a68fcbb76b87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139717 Jul 28 03:43:44.250220 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 358/707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:44 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:45.266214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c04146ff-82fb-42f0-8cfa-dc037db81466 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:45.266828 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c04146ff-82fb-42f0-8cfa-dc037db81466 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:45.272672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c04146ff-82fb-42f0-8cfa-dc037db81466 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:45.273124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c04146ff-82fb-42f0-8cfa-dc037db81466 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:45.273919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c04146ff-82fb-42f0-8cfa-dc037db81466 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:45.274370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c04146ff-82fb-42f0-8cfa-dc037db81466 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:45.392461 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c04146ff-82fb-42f0-8cfa-dc037db81466 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:45.400332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c04146ff-82fb-42f0-8cfa-dc037db81466 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137841 Jul 28 03:43:45.400895 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 350/708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:45 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:46.417469 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-12abd5e3-e427-43c0-b3f1-39312732bd68 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:46.417995 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-12abd5e3-e427-43c0-b3f1-39312732bd68 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:46.423849 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-12abd5e3-e427-43c0-b3f1-39312732bd68 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:46.424290 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-12abd5e3-e427-43c0-b3f1-39312732bd68 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:46.425042 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-12abd5e3-e427-43c0-b3f1-39312732bd68 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:46.425468 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-12abd5e3-e427-43c0-b3f1-39312732bd68 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:46.547086 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-12abd5e3-e427-43c0-b3f1-39312732bd68 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:46.554904 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-12abd5e3-e427-43c0-b3f1-39312732bd68 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141171 Jul 28 03:43:46.555463 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 359/709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:46 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:47.572019 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c97418ee-8fbf-4606-bdab-69e26aa29382 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:47.572567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c97418ee-8fbf-4606-bdab-69e26aa29382 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:47.578188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c97418ee-8fbf-4606-bdab-69e26aa29382 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:47.578631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c97418ee-8fbf-4606-bdab-69e26aa29382 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:47.579390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c97418ee-8fbf-4606-bdab-69e26aa29382 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:47.579848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c97418ee-8fbf-4606-bdab-69e26aa29382 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:47.700253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c97418ee-8fbf-4606-bdab-69e26aa29382 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:47.708074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c97418ee-8fbf-4606-bdab-69e26aa29382 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139470 Jul 28 03:43:47.708644 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 351/710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:47 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:48.725612 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a08e25a3-33fa-4a8a-b82a-6c3df9a76ed2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:48.726219 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a08e25a3-33fa-4a8a-b82a-6c3df9a76ed2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:48.732159 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a08e25a3-33fa-4a8a-b82a-6c3df9a76ed2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:48.732615 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a08e25a3-33fa-4a8a-b82a-6c3df9a76ed2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:48.733383 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a08e25a3-33fa-4a8a-b82a-6c3df9a76ed2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:48.733818 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a08e25a3-33fa-4a8a-b82a-6c3df9a76ed2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:48.853032 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a08e25a3-33fa-4a8a-b82a-6c3df9a76ed2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:48.860436 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a08e25a3-33fa-4a8a-b82a-6c3df9a76ed2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139208 Jul 28 03:43:48.860992 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 360/711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:48 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:49.877509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-37dde6ad-4b74-4435-84ee-40d66d1bc295 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:49.878122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-37dde6ad-4b74-4435-84ee-40d66d1bc295 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:49.884048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37dde6ad-4b74-4435-84ee-40d66d1bc295 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:49.884501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37dde6ad-4b74-4435-84ee-40d66d1bc295 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:49.885267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37dde6ad-4b74-4435-84ee-40d66d1bc295 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:49.885700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37dde6ad-4b74-4435-84ee-40d66d1bc295 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:50.005850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-37dde6ad-4b74-4435-84ee-40d66d1bc295 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:50.013009 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-37dde6ad-4b74-4435-84ee-40d66d1bc295 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139141 Jul 28 03:43:50.013561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 352/712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:49 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:51.030284 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-47416389-e61f-43da-96dc-e43062922a84 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:51.030891 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-47416389-e61f-43da-96dc-e43062922a84 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:51.037251 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47416389-e61f-43da-96dc-e43062922a84 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:51.037697 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47416389-e61f-43da-96dc-e43062922a84 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:51.038458 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47416389-e61f-43da-96dc-e43062922a84 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:51.038883 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47416389-e61f-43da-96dc-e43062922a84 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:51.158097 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-47416389-e61f-43da-96dc-e43062922a84 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:51.166256 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-47416389-e61f-43da-96dc-e43062922a84 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139613 Jul 28 03:43:51.166816 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 361/713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:51 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:52.183269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-18717376-d4c3-49d9-862e-df0b94207cf3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:52.183906 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-18717376-d4c3-49d9-862e-df0b94207cf3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:52.189892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18717376-d4c3-49d9-862e-df0b94207cf3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:52.190333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18717376-d4c3-49d9-862e-df0b94207cf3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:52.191089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18717376-d4c3-49d9-862e-df0b94207cf3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:52.191628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18717376-d4c3-49d9-862e-df0b94207cf3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:52.309908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-18717376-d4c3-49d9-862e-df0b94207cf3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:52.317169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-18717376-d4c3-49d9-862e-df0b94207cf3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137487 Jul 28 03:43:52.317723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 353/714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:52 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:53.334392 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-6409e5c5-aa7d-4230-af5c-19ab8a5f8e22 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:53.335247 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-6409e5c5-aa7d-4230-af5c-19ab8a5f8e22 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:53.340972 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6409e5c5-aa7d-4230-af5c-19ab8a5f8e22 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:53.341421 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6409e5c5-aa7d-4230-af5c-19ab8a5f8e22 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:53.342191 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6409e5c5-aa7d-4230-af5c-19ab8a5f8e22 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:53.342625 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-6409e5c5-aa7d-4230-af5c-19ab8a5f8e22 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:53.469557 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-6409e5c5-aa7d-4230-af5c-19ab8a5f8e22 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:53.477733 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-6409e5c5-aa7d-4230-af5c-19ab8a5f8e22 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.147302 Jul 28 03:43:53.478283 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 362/715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:53 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:54.496075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dbf455ad-1b6d-4e50-9cd9-e762eead2d50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:54.496608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dbf455ad-1b6d-4e50-9cd9-e762eead2d50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:54.502449 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbf455ad-1b6d-4e50-9cd9-e762eead2d50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:54.502899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbf455ad-1b6d-4e50-9cd9-e762eead2d50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:54.503661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbf455ad-1b6d-4e50-9cd9-e762eead2d50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:54.504758 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbf455ad-1b6d-4e50-9cd9-e762eead2d50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:54.621558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dbf455ad-1b6d-4e50-9cd9-e762eead2d50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:54.628691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dbf455ad-1b6d-4e50-9cd9-e762eead2d50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136492 Jul 28 03:43:54.630247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 354/716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:54 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:55.646494 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-aa1be30d-8d45-41ab-8bee-8a17b67a8218 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:55.647142 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-aa1be30d-8d45-41ab-8bee-8a17b67a8218 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:55.653081 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-aa1be30d-8d45-41ab-8bee-8a17b67a8218 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:55.653531 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-aa1be30d-8d45-41ab-8bee-8a17b67a8218 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:55.654296 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-aa1be30d-8d45-41ab-8bee-8a17b67a8218 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:55.654756 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-aa1be30d-8d45-41ab-8bee-8a17b67a8218 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:55.774675 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-aa1be30d-8d45-41ab-8bee-8a17b67a8218 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:55.782006 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-aa1be30d-8d45-41ab-8bee-8a17b67a8218 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139766 Jul 28 03:43:55.782559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 363/717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:55 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:56.799546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-22c99d57-388b-45a5-9a55-835fa5f1fa6b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:56.800190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-22c99d57-388b-45a5-9a55-835fa5f1fa6b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:56.806093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-22c99d57-388b-45a5-9a55-835fa5f1fa6b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:56.806546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-22c99d57-388b-45a5-9a55-835fa5f1fa6b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:56.807344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-22c99d57-388b-45a5-9a55-835fa5f1fa6b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:56.807812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-22c99d57-388b-45a5-9a55-835fa5f1fa6b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:56.929016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-22c99d57-388b-45a5-9a55-835fa5f1fa6b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:56.936274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-22c99d57-388b-45a5-9a55-835fa5f1fa6b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.140372 Jul 28 03:43:56.936838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 355/718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:56 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:57.952757 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a963b3a0-eed3-418f-be21-cc1ec13dcc69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:57.953390 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a963b3a0-eed3-418f-be21-cc1ec13dcc69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:57.960037 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a963b3a0-eed3-418f-be21-cc1ec13dcc69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:57.960478 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a963b3a0-eed3-418f-be21-cc1ec13dcc69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:57.961229 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a963b3a0-eed3-418f-be21-cc1ec13dcc69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:57.961676 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a963b3a0-eed3-418f-be21-cc1ec13dcc69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:58.079168 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a963b3a0-eed3-418f-be21-cc1ec13dcc69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:58.087068 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a963b3a0-eed3-418f-be21-cc1ec13dcc69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137933 Jul 28 03:43:58.087623 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 364/719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:57 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:59.104550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5350bee9-051b-48f8-a86c-d296761c7394 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:59.105160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5350bee9-051b-48f8-a86c-d296761c7394 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:43:59.110962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5350bee9-051b-48f8-a86c-d296761c7394 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:59.111410 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5350bee9-051b-48f8-a86c-d296761c7394 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:59.112213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5350bee9-051b-48f8-a86c-d296761c7394 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:43:59.112648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5350bee9-051b-48f8-a86c-d296761c7394 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:43:59.231761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5350bee9-051b-48f8-a86c-d296761c7394 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:59.238955 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5350bee9-051b-48f8-a86c-d296761c7394 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138059 Jul 28 03:43:59.239519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 356/720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:43:59 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:00.255505 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c9b3e54f-d8f3-44b9-8de3-321bef210317 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:00.256151 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c9b3e54f-d8f3-44b9-8de3-321bef210317 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:00.261923 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9b3e54f-d8f3-44b9-8de3-321bef210317 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:00.262363 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9b3e54f-d8f3-44b9-8de3-321bef210317 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:00.263127 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9b3e54f-d8f3-44b9-8de3-321bef210317 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:00.263554 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9b3e54f-d8f3-44b9-8de3-321bef210317 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:00.385826 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c9b3e54f-d8f3-44b9-8de3-321bef210317 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:00.393018 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c9b3e54f-d8f3-44b9-8de3-321bef210317 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141693 Jul 28 03:44:00.393566 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 365/721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:00 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:01.416584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-af1458cb-003a-4bd3-ae4f-9d6e26d6ce10 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:01.417102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-af1458cb-003a-4bd3-ae4f-9d6e26d6ce10 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:01.423037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af1458cb-003a-4bd3-ae4f-9d6e26d6ce10 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:01.423485 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af1458cb-003a-4bd3-ae4f-9d6e26d6ce10 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:01.424271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af1458cb-003a-4bd3-ae4f-9d6e26d6ce10 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:01.424711 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af1458cb-003a-4bd3-ae4f-9d6e26d6ce10 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:01.542386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-af1458cb-003a-4bd3-ae4f-9d6e26d6ce10 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:01.549548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-af1458cb-003a-4bd3-ae4f-9d6e26d6ce10 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136729 Jul 28 03:44:01.550107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 357/722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:01 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:02.566761 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-94a4b3a5-7037-416e-834c-3af14a093861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:02.567277 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-94a4b3a5-7037-416e-834c-3af14a093861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:02.574638 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94a4b3a5-7037-416e-834c-3af14a093861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:02.575079 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94a4b3a5-7037-416e-834c-3af14a093861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:02.575864 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94a4b3a5-7037-416e-834c-3af14a093861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:02.576549 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-94a4b3a5-7037-416e-834c-3af14a093861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:02.696372 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-94a4b3a5-7037-416e-834c-3af14a093861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:02.703576 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-94a4b3a5-7037-416e-834c-3af14a093861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.140532 Jul 28 03:44:02.704145 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 366/723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:02 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:03.721409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-aae6029a-cadf-4070-870a-a988a934cec0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:03.722261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-aae6029a-cadf-4070-870a-a988a934cec0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:03.728631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aae6029a-cadf-4070-870a-a988a934cec0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:03.729071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aae6029a-cadf-4070-870a-a988a934cec0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:03.729826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aae6029a-cadf-4070-870a-a988a934cec0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:03.730258 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aae6029a-cadf-4070-870a-a988a934cec0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:03.853988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-aae6029a-cadf-4070-870a-a988a934cec0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:03.861448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-aae6029a-cadf-4070-870a-a988a934cec0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.143870 Jul 28 03:44:03.862003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 358/724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:03 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:04.878113 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-82e23e83-9216-40a5-9c01-ce5fac1cd18c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:04.878716 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-82e23e83-9216-40a5-9c01-ce5fac1cd18c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:04.885169 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-82e23e83-9216-40a5-9c01-ce5fac1cd18c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:04.885605 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-82e23e83-9216-40a5-9c01-ce5fac1cd18c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:04.886360 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-82e23e83-9216-40a5-9c01-ce5fac1cd18c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:04.886783 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-82e23e83-9216-40a5-9c01-ce5fac1cd18c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:05.006422 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-82e23e83-9216-40a5-9c01-ce5fac1cd18c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:05.013755 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-82e23e83-9216-40a5-9c01-ce5fac1cd18c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139259 Jul 28 03:44:05.014309 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 367/725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:04 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:06.031290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b697cd39-ab16-4eb1-8f32-e045e8123e23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:06.031859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b697cd39-ab16-4eb1-8f32-e045e8123e23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:06.038212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b697cd39-ab16-4eb1-8f32-e045e8123e23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:06.038660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b697cd39-ab16-4eb1-8f32-e045e8123e23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:06.039808 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b697cd39-ab16-4eb1-8f32-e045e8123e23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:06.039908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b697cd39-ab16-4eb1-8f32-e045e8123e23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:06.158253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b697cd39-ab16-4eb1-8f32-e045e8123e23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:06.166088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b697cd39-ab16-4eb1-8f32-e045e8123e23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138516 Jul 28 03:44:06.166649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 359/726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:06 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:07.182215 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-a6fc61f4-501f-4149-825e-e195b8024db9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:07.182823 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-a6fc61f4-501f-4149-825e-e195b8024db9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:07.188632 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a6fc61f4-501f-4149-825e-e195b8024db9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:07.189078 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a6fc61f4-501f-4149-825e-e195b8024db9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:07.189841 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a6fc61f4-501f-4149-825e-e195b8024db9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:07.190271 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-a6fc61f4-501f-4149-825e-e195b8024db9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:07.310930 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-a6fc61f4-501f-4149-825e-e195b8024db9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:07.318511 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-a6fc61f4-501f-4149-825e-e195b8024db9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139960 Jul 28 03:44:07.319071 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 368/727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:07 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:08.335540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-72a70cd1-1e06-4569-bc2b-f34c42f501f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:08.336189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-72a70cd1-1e06-4569-bc2b-f34c42f501f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:08.341989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72a70cd1-1e06-4569-bc2b-f34c42f501f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:08.342440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72a70cd1-1e06-4569-bc2b-f34c42f501f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:08.343203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72a70cd1-1e06-4569-bc2b-f34c42f501f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:08.343637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72a70cd1-1e06-4569-bc2b-f34c42f501f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:08.466126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-72a70cd1-1e06-4569-bc2b-f34c42f501f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:08.473467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-72a70cd1-1e06-4569-bc2b-f34c42f501f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141758 Jul 28 03:44:08.474530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 360/728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:08 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:09.491374 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-ebf8ba74-4fea-4d47-aa69-cd4206b5e7c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:09.491943 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-ebf8ba74-4fea-4d47-aa69-cd4206b5e7c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:09.497736 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ebf8ba74-4fea-4d47-aa69-cd4206b5e7c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:09.498180 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ebf8ba74-4fea-4d47-aa69-cd4206b5e7c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:09.498945 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ebf8ba74-4fea-4d47-aa69-cd4206b5e7c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:09.499378 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-ebf8ba74-4fea-4d47-aa69-cd4206b5e7c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:09.616530 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-ebf8ba74-4fea-4d47-aa69-cd4206b5e7c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:09.623796 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-ebf8ba74-4fea-4d47-aa69-cd4206b5e7c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136662 Jul 28 03:44:09.624353 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 369/729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:09 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:10.641227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-95abb112-d70b-4c68-8d02-a8750fe55f6e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:10.641832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-95abb112-d70b-4c68-8d02-a8750fe55f6e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:10.648444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-95abb112-d70b-4c68-8d02-a8750fe55f6e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:10.648890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-95abb112-d70b-4c68-8d02-a8750fe55f6e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:10.649647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-95abb112-d70b-4c68-8d02-a8750fe55f6e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:10.650154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-95abb112-d70b-4c68-8d02-a8750fe55f6e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:10.771169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-95abb112-d70b-4c68-8d02-a8750fe55f6e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:10.778435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-95abb112-d70b-4c68-8d02-a8750fe55f6e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.140870 Jul 28 03:44:10.778993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 361/730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:10 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:11.795496 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-198fb10e-751a-4c98-b52a-710310f2e058 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:11.796131 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-198fb10e-751a-4c98-b52a-710310f2e058 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:11.802027 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-198fb10e-751a-4c98-b52a-710310f2e058 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:11.802644 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-198fb10e-751a-4c98-b52a-710310f2e058 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:11.803412 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-198fb10e-751a-4c98-b52a-710310f2e058 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:11.803957 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-198fb10e-751a-4c98-b52a-710310f2e058 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:11.923159 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-198fb10e-751a-4c98-b52a-710310f2e058 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:11.930558 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-198fb10e-751a-4c98-b52a-710310f2e058 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138684 Jul 28 03:44:11.931116 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 370/731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:11 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:12.947533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5cfcbac4-fb09-4e85-a229-0ce75ccfd53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:12.948171 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5cfcbac4-fb09-4e85-a229-0ce75ccfd53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:12.953987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5cfcbac4-fb09-4e85-a229-0ce75ccfd53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:12.954427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5cfcbac4-fb09-4e85-a229-0ce75ccfd53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:12.955180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5cfcbac4-fb09-4e85-a229-0ce75ccfd53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:12.955608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5cfcbac4-fb09-4e85-a229-0ce75ccfd53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:13.073904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5cfcbac4-fb09-4e85-a229-0ce75ccfd53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:13.081117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5cfcbac4-fb09-4e85-a229-0ce75ccfd53e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137200 Jul 28 03:44:13.081669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 362/732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:12 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:44:14.099338 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-4f87e48c-51b5-4d05-862a-af36dff9ab9a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:14.099999 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-4f87e48c-51b5-4d05-862a-af36dff9ab9a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:14.105748 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4f87e48c-51b5-4d05-862a-af36dff9ab9a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:14.106189 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4f87e48c-51b5-4d05-862a-af36dff9ab9a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:14.106951 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4f87e48c-51b5-4d05-862a-af36dff9ab9a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:14.107411 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4f87e48c-51b5-4d05-862a-af36dff9ab9a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:14.230657 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-4f87e48c-51b5-4d05-862a-af36dff9ab9a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:14.237832 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-4f87e48c-51b5-4d05-862a-af36dff9ab9a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.142659 Jul 28 03:44:14.238386 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 371/733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:14 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:15.255643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8941d223-b71e-49ff-a5eb-628e187cb6d7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:15.256359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8941d223-b71e-49ff-a5eb-628e187cb6d7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:15.262013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8941d223-b71e-49ff-a5eb-628e187cb6d7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:15.262457 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8941d223-b71e-49ff-a5eb-628e187cb6d7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:15.263220 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8941d223-b71e-49ff-a5eb-628e187cb6d7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:15.263653 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8941d223-b71e-49ff-a5eb-628e187cb6d7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:15.380573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8941d223-b71e-49ff-a5eb-628e187cb6d7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:15.387828 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8941d223-b71e-49ff-a5eb-628e187cb6d7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.135893 Jul 28 03:44:15.388381 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 363/734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:15 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:16.405432 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b8989ec7-80bd-4894-8818-ae325a718f9c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:16.405998 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b8989ec7-80bd-4894-8818-ae325a718f9c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:16.412542 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b8989ec7-80bd-4894-8818-ae325a718f9c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:16.412994 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b8989ec7-80bd-4894-8818-ae325a718f9c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:16.413746 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b8989ec7-80bd-4894-8818-ae325a718f9c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:16.414171 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b8989ec7-80bd-4894-8818-ae325a718f9c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:16.531725 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b8989ec7-80bd-4894-8818-ae325a718f9c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:16.539645 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b8989ec7-80bd-4894-8818-ae325a718f9c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137914 Jul 28 03:44:16.540229 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 372/735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:16 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:17.652085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fa5b6c12-3df8-43eb-956d-dc1883574aee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:17.652698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fa5b6c12-3df8-43eb-956d-dc1883574aee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:17.658496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa5b6c12-3df8-43eb-956d-dc1883574aee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:17.658951 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa5b6c12-3df8-43eb-956d-dc1883574aee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:17.659738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa5b6c12-3df8-43eb-956d-dc1883574aee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:17.660153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa5b6c12-3df8-43eb-956d-dc1883574aee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:17.782622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fa5b6c12-3df8-43eb-956d-dc1883574aee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:17.790245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fa5b6c12-3df8-43eb-956d-dc1883574aee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.236496 Jul 28 03:44:17.790832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 364/736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:17 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:18.806126 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-641c8522-fa47-475b-803c-e62ff3522c81 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:18.806732 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-641c8522-fa47-475b-803c-e62ff3522c81 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:18.812649 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-641c8522-fa47-475b-803c-e62ff3522c81 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:18.813087 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-641c8522-fa47-475b-803c-e62ff3522c81 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:18.813839 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-641c8522-fa47-475b-803c-e62ff3522c81 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:18.814264 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-641c8522-fa47-475b-803c-e62ff3522c81 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:18.933076 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-641c8522-fa47-475b-803c-e62ff3522c81 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:18.940325 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-641c8522-fa47-475b-803c-e62ff3522c81 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137851 Jul 28 03:44:18.940875 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 373/737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:18 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:19.958215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6b57f7d7-90bf-4f80-a4db-4f3774cd053d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:19.958872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6b57f7d7-90bf-4f80-a4db-4f3774cd053d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:19.964720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b57f7d7-90bf-4f80-a4db-4f3774cd053d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:19.965172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b57f7d7-90bf-4f80-a4db-4f3774cd053d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:19.965936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b57f7d7-90bf-4f80-a4db-4f3774cd053d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:19.966371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b57f7d7-90bf-4f80-a4db-4f3774cd053d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:20.084522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6b57f7d7-90bf-4f80-a4db-4f3774cd053d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:20.091689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6b57f7d7-90bf-4f80-a4db-4f3774cd053d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137681 Jul 28 03:44:20.092267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 365/738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:19 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:21.109737 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-219d790d-7e3e-4919-8808-6e9ce339e51c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:21.110349 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-219d790d-7e3e-4919-8808-6e9ce339e51c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:21.117047 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-219d790d-7e3e-4919-8808-6e9ce339e51c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:21.117498 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-219d790d-7e3e-4919-8808-6e9ce339e51c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:21.118288 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-219d790d-7e3e-4919-8808-6e9ce339e51c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:21.118726 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-219d790d-7e3e-4919-8808-6e9ce339e51c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:21.242094 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-219d790d-7e3e-4919-8808-6e9ce339e51c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:21.249325 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-219d790d-7e3e-4919-8808-6e9ce339e51c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.143386 Jul 28 03:44:21.249888 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 374/739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:21 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:22.266435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bdf26949-0fb5-4eae-b27b-d67a670c16a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:22.267051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bdf26949-0fb5-4eae-b27b-d67a670c16a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:22.272877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bdf26949-0fb5-4eae-b27b-d67a670c16a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:22.273327 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bdf26949-0fb5-4eae-b27b-d67a670c16a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:22.274088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bdf26949-0fb5-4eae-b27b-d67a670c16a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:22.274520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bdf26949-0fb5-4eae-b27b-d67a670c16a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:22.392493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bdf26949-0fb5-4eae-b27b-d67a670c16a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:22.399677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bdf26949-0fb5-4eae-b27b-d67a670c16a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136967 Jul 28 03:44:22.400252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 366/740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:22 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:23.415646 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-163be8be-6cae-4733-8d26-c095071db2ff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:23.416267 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-163be8be-6cae-4733-8d26-c095071db2ff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:23.421936 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-163be8be-6cae-4733-8d26-c095071db2ff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:23.422378 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-163be8be-6cae-4733-8d26-c095071db2ff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:23.423129 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-163be8be-6cae-4733-8d26-c095071db2ff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:23.423559 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-163be8be-6cae-4733-8d26-c095071db2ff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:23.541638 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-163be8be-6cae-4733-8d26-c095071db2ff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:23.548831 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-163be8be-6cae-4733-8d26-c095071db2ff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136900 Jul 28 03:44:23.549385 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 375/741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:23 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:44:24.566008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d107e4c8-1d7e-4c14-a135-43204c126351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:24.566554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d107e4c8-1d7e-4c14-a135-43204c126351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:24.572404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d107e4c8-1d7e-4c14-a135-43204c126351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:24.572854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d107e4c8-1d7e-4c14-a135-43204c126351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:24.573630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d107e4c8-1d7e-4c14-a135-43204c126351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:24.574068 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d107e4c8-1d7e-4c14-a135-43204c126351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:24.700258 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d107e4c8-1d7e-4c14-a135-43204c126351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:24.707483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d107e4c8-1d7e-4c14-a135-43204c126351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.145196 Jul 28 03:44:24.708836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 367/742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:24 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:25.726044 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-92b7b9ef-8802-4854-b770-b12cbb6ff972 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:25.726656 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-92b7b9ef-8802-4854-b770-b12cbb6ff972 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:25.732509 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-92b7b9ef-8802-4854-b770-b12cbb6ff972 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:25.732954 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-92b7b9ef-8802-4854-b770-b12cbb6ff972 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:25.733718 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-92b7b9ef-8802-4854-b770-b12cbb6ff972 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:25.734147 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-92b7b9ef-8802-4854-b770-b12cbb6ff972 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:25.854221 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-92b7b9ef-8802-4854-b770-b12cbb6ff972 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:25.861447 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-92b7b9ef-8802-4854-b770-b12cbb6ff972 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.140006 Jul 28 03:44:25.862004 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 376/743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:25 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:26.878055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-956e2eaf-b408-48eb-af1e-6a47b975cad2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:26.878675 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-956e2eaf-b408-48eb-af1e-6a47b975cad2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:26.885075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-956e2eaf-b408-48eb-af1e-6a47b975cad2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:26.885522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-956e2eaf-b408-48eb-af1e-6a47b975cad2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:26.886282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-956e2eaf-b408-48eb-af1e-6a47b975cad2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:26.886712 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-956e2eaf-b408-48eb-af1e-6a47b975cad2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:27.011372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-956e2eaf-b408-48eb-af1e-6a47b975cad2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:27.018634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-956e2eaf-b408-48eb-af1e-6a47b975cad2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.144271 Jul 28 03:44:27.019186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 368/744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:26 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:28.036316 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-e74deabd-0b5b-4e63-b6b4-e00963966599 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:28.036841 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-e74deabd-0b5b-4e63-b6b4-e00963966599 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:28.042872 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e74deabd-0b5b-4e63-b6b4-e00963966599 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:28.043313 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e74deabd-0b5b-4e63-b6b4-e00963966599 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:28.044094 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e74deabd-0b5b-4e63-b6b4-e00963966599 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:28.044523 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-e74deabd-0b5b-4e63-b6b4-e00963966599 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:28.166744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-e74deabd-0b5b-4e63-b6b4-e00963966599 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:28.174092 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-e74deabd-0b5b-4e63-b6b4-e00963966599 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.141628 Jul 28 03:44:28.174641 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 377/745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:28 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:29.191672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8db7983e-3e15-45d3-a2f7-4a7f73a0ff71 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:29.192512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8db7983e-3e15-45d3-a2f7-4a7f73a0ff71 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:29.198150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8db7983e-3e15-45d3-a2f7-4a7f73a0ff71 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:29.198579 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8db7983e-3e15-45d3-a2f7-4a7f73a0ff71 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:29.199343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8db7983e-3e15-45d3-a2f7-4a7f73a0ff71 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:29.199805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8db7983e-3e15-45d3-a2f7-4a7f73a0ff71 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:29.317694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8db7983e-3e15-45d3-a2f7-4a7f73a0ff71 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:29.325151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8db7983e-3e15-45d3-a2f7-4a7f73a0ff71 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137147 Jul 28 03:44:29.325956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 369/746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:29 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:30.342047 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-22077732-2e65-48e0-9c22-8a4a99165d1d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:30.342642 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-22077732-2e65-48e0-9c22-8a4a99165d1d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:30.349901 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-22077732-2e65-48e0-9c22-8a4a99165d1d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:30.350342 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-22077732-2e65-48e0-9c22-8a4a99165d1d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:30.351101 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-22077732-2e65-48e0-9c22-8a4a99165d1d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:30.351528 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-22077732-2e65-48e0-9c22-8a4a99165d1d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:30.472732 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-22077732-2e65-48e0-9c22-8a4a99165d1d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:30.480753 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-22077732-2e65-48e0-9c22-8a4a99165d1d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.142338 Jul 28 03:44:30.481310 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 378/747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:30 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:31.498796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5742299d-f5a2-4489-ade1-1085140adab0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:31.499332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5742299d-f5a2-4489-ade1-1085140adab0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:31.505402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5742299d-f5a2-4489-ade1-1085140adab0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:31.505851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5742299d-f5a2-4489-ade1-1085140adab0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:31.506619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5742299d-f5a2-4489-ade1-1085140adab0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:31.507054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5742299d-f5a2-4489-ade1-1085140adab0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:31.629873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5742299d-f5a2-4489-ade1-1085140adab0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:31.637066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5742299d-f5a2-4489-ade1-1085140adab0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.142005 Jul 28 03:44:31.637624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 370/748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:31 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:32.654035 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-03bc8598-fca5-4966-8407-03126ff53f7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:32.654628 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-03bc8598-fca5-4966-8407-03126ff53f7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:32.660496 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-03bc8598-fca5-4966-8407-03126ff53f7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:32.660986 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-03bc8598-fca5-4966-8407-03126ff53f7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:32.661888 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-03bc8598-fca5-4966-8407-03126ff53f7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:32.662322 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-03bc8598-fca5-4966-8407-03126ff53f7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:32.779898 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-03bc8598-fca5-4966-8407-03126ff53f7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:32.787728 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-03bc8598-fca5-4966-8407-03126ff53f7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137328 Jul 28 03:44:32.788292 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 379/749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:32 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:33.805041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5a8cd9f1-6612-4f87-9f37-324510cb4d38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:33.805658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5a8cd9f1-6612-4f87-9f37-324510cb4d38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:33.811645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a8cd9f1-6612-4f87-9f37-324510cb4d38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:33.812126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a8cd9f1-6612-4f87-9f37-324510cb4d38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:33.812894 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a8cd9f1-6612-4f87-9f37-324510cb4d38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:33.813328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a8cd9f1-6612-4f87-9f37-324510cb4d38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:33.932313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5a8cd9f1-6612-4f87-9f37-324510cb4d38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:33.939464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5a8cd9f1-6612-4f87-9f37-324510cb4d38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138174 Jul 28 03:44:33.940052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 371/750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:33 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:34.957015 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-db504ee3-bc26-434c-b9bb-2b276289805d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:34.958102 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-db504ee3-bc26-434c-b9bb-2b276289805d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:34.963984 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-db504ee3-bc26-434c-b9bb-2b276289805d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:34.964432 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-db504ee3-bc26-434c-b9bb-2b276289805d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:34.965194 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-db504ee3-bc26-434c-b9bb-2b276289805d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:34.965621 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-db504ee3-bc26-434c-b9bb-2b276289805d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:35.081641 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-db504ee3-bc26-434c-b9bb-2b276289805d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:35.089675 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-db504ee3-bc26-434c-b9bb-2b276289805d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.136320 Jul 28 03:44:35.090222 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 380/751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:34 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:36.107636 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b074a70f-2258-4efb-abbb-203841fb9768 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:36.108280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b074a70f-2258-4efb-abbb-203841fb9768 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:36.114866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b074a70f-2258-4efb-abbb-203841fb9768 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:36.115312 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b074a70f-2258-4efb-abbb-203841fb9768 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:36.116115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b074a70f-2258-4efb-abbb-203841fb9768 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:36.116552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b074a70f-2258-4efb-abbb-203841fb9768 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:36.234563 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b074a70f-2258-4efb-abbb-203841fb9768 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:36.242609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b074a70f-2258-4efb-abbb-203841fb9768 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138641 Jul 28 03:44:36.243161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 372/752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:36 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:37.260177 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d90dc842-5120-423f-9f8e-4a3411816212 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:37.260783 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d90dc842-5120-423f-9f8e-4a3411816212 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:37.266561 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d90dc842-5120-423f-9f8e-4a3411816212 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:37.267006 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d90dc842-5120-423f-9f8e-4a3411816212 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:37.267786 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d90dc842-5120-423f-9f8e-4a3411816212 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:37.268220 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d90dc842-5120-423f-9f8e-4a3411816212 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:37.388998 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d90dc842-5120-423f-9f8e-4a3411816212 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:37.396435 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d90dc842-5120-423f-9f8e-4a3411816212 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139912 Jul 28 03:44:37.396991 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 381/753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:37 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:38.413479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4d02265f-30f8-4c4e-9ea4-e3945ceb3616 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:38.414008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4d02265f-30f8-4c4e-9ea4-e3945ceb3616 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:38.419853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4d02265f-30f8-4c4e-9ea4-e3945ceb3616 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:38.420309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4d02265f-30f8-4c4e-9ea4-e3945ceb3616 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:38.421078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4d02265f-30f8-4c4e-9ea4-e3945ceb3616 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:38.421515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4d02265f-30f8-4c4e-9ea4-e3945ceb3616 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:38.542238 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4d02265f-30f8-4c4e-9ea4-e3945ceb3616 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:38.549419 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4d02265f-30f8-4c4e-9ea4-e3945ceb3616 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.139856 Jul 28 03:44:38.549983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 373/754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:38 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:39.567227 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-47c20b79-002e-48e9-b8ae-cfbcbfaea994 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:39.567791 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-47c20b79-002e-48e9-b8ae-cfbcbfaea994 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:39.573463 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47c20b79-002e-48e9-b8ae-cfbcbfaea994 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:39.573901 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47c20b79-002e-48e9-b8ae-cfbcbfaea994 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:39.574669 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47c20b79-002e-48e9-b8ae-cfbcbfaea994 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:39.575103 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-47c20b79-002e-48e9-b8ae-cfbcbfaea994 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:39.693125 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-47c20b79-002e-48e9-b8ae-cfbcbfaea994 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:39.700330 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-47c20b79-002e-48e9-b8ae-cfbcbfaea994 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.137023 Jul 28 03:44:39.700883 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 382/755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:39 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:40.718145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f06593ae-9f40-4a80-870a-5a83c95b8240 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:40.718765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f06593ae-9f40-4a80-870a-5a83c95b8240 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:40.725510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f06593ae-9f40-4a80-870a-5a83c95b8240 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:40.725962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f06593ae-9f40-4a80-870a-5a83c95b8240 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:40.726732 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f06593ae-9f40-4a80-870a-5a83c95b8240 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:40.727188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f06593ae-9f40-4a80-870a-5a83c95b8240 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:40.844981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f06593ae-9f40-4a80-870a-5a83c95b8240 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:40.853045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f06593ae-9f40-4a80-870a-5a83c95b8240 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.138626 Jul 28 03:44:40.853603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 374/756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:40 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:41.872143 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-4479b957-6ca8-4aa7-8784-63a9b72464cc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:41.873114 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-4479b957-6ca8-4aa7-8784-63a9b72464cc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:41.879243 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4479b957-6ca8-4aa7-8784-63a9b72464cc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:41.880354 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4479b957-6ca8-4aa7-8784-63a9b72464cc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:41.881269 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4479b957-6ca8-4aa7-8784-63a9b72464cc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:41.881544 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-4479b957-6ca8-4aa7-8784-63a9b72464cc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:42.001112 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-4479b957-6ca8-4aa7-8784-63a9b72464cc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:42.009197 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-4479b957-6ca8-4aa7-8784-63a9b72464cc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.141841 Jul 28 03:44:42.009751 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 383/757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:41 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:44:43.026365 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1b5376a3-69f2-4f3d-ab0c-6f29c02c6370 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:43.026981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1b5376a3-69f2-4f3d-ab0c-6f29c02c6370 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:43.032722 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b5376a3-69f2-4f3d-ab0c-6f29c02c6370 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:43.033171 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b5376a3-69f2-4f3d-ab0c-6f29c02c6370 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:43.033936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b5376a3-69f2-4f3d-ab0c-6f29c02c6370 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:43.034369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b5376a3-69f2-4f3d-ab0c-6f29c02c6370 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:43.155003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1b5376a3-69f2-4f3d-ab0c-6f29c02c6370 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:43.162908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1b5376a3-69f2-4f3d-ab0c-6f29c02c6370 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140256 Jul 28 03:44:43.163463 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 375/758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:43 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:44.179280 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-23b5bc29-d0bd-4c2f-8972-51734d989876 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:44.179919 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-23b5bc29-d0bd-4c2f-8972-51734d989876 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:44.185751 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-23b5bc29-d0bd-4c2f-8972-51734d989876 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:44.186194 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-23b5bc29-d0bd-4c2f-8972-51734d989876 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:44.186953 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-23b5bc29-d0bd-4c2f-8972-51734d989876 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:44.187385 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-23b5bc29-d0bd-4c2f-8972-51734d989876 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:44.308817 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-23b5bc29-d0bd-4c2f-8972-51734d989876 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:44.315884 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-23b5bc29-d0bd-4c2f-8972-51734d989876 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140815 Jul 28 03:44:44.316435 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 384/759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:44 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:45.332867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-26adb4bb-a6fd-4634-905b-c3fba7c4a9f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:45.333402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-26adb4bb-a6fd-4634-905b-c3fba7c4a9f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:45.339274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26adb4bb-a6fd-4634-905b-c3fba7c4a9f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:45.339752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26adb4bb-a6fd-4634-905b-c3fba7c4a9f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:45.340524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26adb4bb-a6fd-4634-905b-c3fba7c4a9f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:45.340963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26adb4bb-a6fd-4634-905b-c3fba7c4a9f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:45.463376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-26adb4bb-a6fd-4634-905b-c3fba7c4a9f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:45.470543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-26adb4bb-a6fd-4634-905b-c3fba7c4a9f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.141531 Jul 28 03:44:45.471101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 376/760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:45 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:46.487700 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5af0de34-6e79-4574-8e2b-0f0dd58e513e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:46.488323 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5af0de34-6e79-4574-8e2b-0f0dd58e513e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:46.494660 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5af0de34-6e79-4574-8e2b-0f0dd58e513e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:46.495100 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5af0de34-6e79-4574-8e2b-0f0dd58e513e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:46.495884 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5af0de34-6e79-4574-8e2b-0f0dd58e513e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:46.496305 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5af0de34-6e79-4574-8e2b-0f0dd58e513e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:46.613102 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5af0de34-6e79-4574-8e2b-0f0dd58e513e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:46.620856 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5af0de34-6e79-4574-8e2b-0f0dd58e513e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.136739 Jul 28 03:44:46.621412 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 385/761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:46 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:47.637964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-50c01cac-6e8a-41cf-a566-a41b6b49d71f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:47.638632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-50c01cac-6e8a-41cf-a566-a41b6b49d71f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:47.644364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50c01cac-6e8a-41cf-a566-a41b6b49d71f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:47.644815 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50c01cac-6e8a-41cf-a566-a41b6b49d71f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:47.645574 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50c01cac-6e8a-41cf-a566-a41b6b49d71f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:47.646003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50c01cac-6e8a-41cf-a566-a41b6b49d71f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:47.765590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-50c01cac-6e8a-41cf-a566-a41b6b49d71f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:47.772843 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-50c01cac-6e8a-41cf-a566-a41b6b49d71f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138576 Jul 28 03:44:47.773401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 377/762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:47 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:48.790537 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5cacbdc4-be65-486d-a6f4-9e21ce4cc790 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:48.791144 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5cacbdc4-be65-486d-a6f4-9e21ce4cc790 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:48.793587 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09491109-d156-450f-b2bd-b708be7a0cad] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 03:44:48.797927 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cacbdc4-be65-486d-a6f4-9e21ce4cc790 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:48.798373 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cacbdc4-be65-486d-a6f4-9e21ce4cc790 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:48.799137 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cacbdc4-be65-486d-a6f4-9e21ce4cc790 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:48.799568 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5cacbdc4-be65-486d-a6f4-9e21ce4cc790 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:48.917093 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5cacbdc4-be65-486d-a6f4-9e21ce4cc790 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:48.924308 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5cacbdc4-be65-486d-a6f4-9e21ce4cc790 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137411 Jul 28 03:44:48.924869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 386/763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:48 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:49.941145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-83c10fd7-f954-48f4-98dd-ca55338c3b38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:49.941756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-83c10fd7-f954-48f4-98dd-ca55338c3b38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:49.947489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83c10fd7-f954-48f4-98dd-ca55338c3b38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:49.948034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83c10fd7-f954-48f4-98dd-ca55338c3b38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:49.948790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83c10fd7-f954-48f4-98dd-ca55338c3b38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:49.949220 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83c10fd7-f954-48f4-98dd-ca55338c3b38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:50.066246 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-83c10fd7-f954-48f4-98dd-ca55338c3b38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:50.073495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-83c10fd7-f954-48f4-98dd-ca55338c3b38 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.136031 Jul 28 03:44:50.074050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 378/764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:49 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:51.090245 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f41b934c-5843-4ef4-b940-6ce39c58553f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:51.090859 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f41b934c-5843-4ef4-b940-6ce39c58553f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:51.107749 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f41b934c-5843-4ef4-b940-6ce39c58553f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:51.108206 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f41b934c-5843-4ef4-b940-6ce39c58553f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:51.108984 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f41b934c-5843-4ef4-b940-6ce39c58553f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:51.109419 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f41b934c-5843-4ef4-b940-6ce39c58553f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:51.124872 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO oslo.messaging._drivers.impl_rabbit [-] [09491109-d156-450f-b2bd-b708be7a0cad] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59570. Jul 28 03:44:51.233986 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f41b934c-5843-4ef4-b940-6ce39c58553f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:51.241328 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f41b934c-5843-4ef4-b940-6ce39c58553f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.154799 Jul 28 03:44:51.241885 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 387/765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:51 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:52.258247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f0805b25-3dab-4e5b-ba63-a1c29c2f3ad1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:52.258857 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f0805b25-3dab-4e5b-ba63-a1c29c2f3ad1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:52.264628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f0805b25-3dab-4e5b-ba63-a1c29c2f3ad1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:52.265075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f0805b25-3dab-4e5b-ba63-a1c29c2f3ad1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:52.265842 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f0805b25-3dab-4e5b-ba63-a1c29c2f3ad1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:52.266274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f0805b25-3dab-4e5b-ba63-a1c29c2f3ad1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:52.391193 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f0805b25-3dab-4e5b-ba63-a1c29c2f3ad1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:52.399416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f0805b25-3dab-4e5b-ba63-a1c29c2f3ad1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.144868 Jul 28 03:44:52.400014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 379/766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:52 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:53.416282 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-b9855df3-fae6-4e9c-9c4c-7bd97299ee8b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:53.416896 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-b9855df3-fae6-4e9c-9c4c-7bd97299ee8b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:53.422578 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b9855df3-fae6-4e9c-9c4c-7bd97299ee8b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:53.423032 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b9855df3-fae6-4e9c-9c4c-7bd97299ee8b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:53.423829 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b9855df3-fae6-4e9c-9c4c-7bd97299ee8b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:53.424263 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-b9855df3-fae6-4e9c-9c4c-7bd97299ee8b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:53.547978 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-b9855df3-fae6-4e9c-9c4c-7bd97299ee8b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:53.556297 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-b9855df3-fae6-4e9c-9c4c-7bd97299ee8b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.143632 Jul 28 03:44:53.556860 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 388/767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:53 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:44:54.573036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-687bcefa-a9a7-4688-906b-d759ac6743ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:54.573648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-687bcefa-a9a7-4688-906b-d759ac6743ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:54.579535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-687bcefa-a9a7-4688-906b-d759ac6743ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:54.579895 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-687bcefa-a9a7-4688-906b-d759ac6743ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:54.580660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-687bcefa-a9a7-4688-906b-d759ac6743ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:54.581266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-687bcefa-a9a7-4688-906b-d759ac6743ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:54.705353 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-687bcefa-a9a7-4688-906b-d759ac6743ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:54.713231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-687bcefa-a9a7-4688-906b-d759ac6743ae tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.143805 Jul 28 03:44:54.713776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 380/768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:54 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:55.730111 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-afeef417-422d-4948-b3a9-c9445a6c4838 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:55.730726 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-afeef417-422d-4948-b3a9-c9445a6c4838 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:55.736494 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-afeef417-422d-4948-b3a9-c9445a6c4838 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:55.736948 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-afeef417-422d-4948-b3a9-c9445a6c4838 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:55.737715 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-afeef417-422d-4948-b3a9-c9445a6c4838 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:55.738151 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-afeef417-422d-4948-b3a9-c9445a6c4838 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:55.856832 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-afeef417-422d-4948-b3a9-c9445a6c4838 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:55.864128 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-afeef417-422d-4948-b3a9-c9445a6c4838 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137599 Jul 28 03:44:55.864691 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 389/769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:55 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:56.881621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f4ffe5b6-0165-4bd8-bf0c-54f8e0cadc27 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:56.882239 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f4ffe5b6-0165-4bd8-bf0c-54f8e0cadc27 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:56.888077 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4ffe5b6-0165-4bd8-bf0c-54f8e0cadc27 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:56.888535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4ffe5b6-0165-4bd8-bf0c-54f8e0cadc27 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:56.889303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4ffe5b6-0165-4bd8-bf0c-54f8e0cadc27 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:56.889745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4ffe5b6-0165-4bd8-bf0c-54f8e0cadc27 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:57.012818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f4ffe5b6-0165-4bd8-bf0c-54f8e0cadc27 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:57.019854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f4ffe5b6-0165-4bd8-bf0c-54f8e0cadc27 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.142467 Jul 28 03:44:57.020410 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 381/770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:56 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:58.037509 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-77f425ce-773f-49a3-9250-4bffabd39a97 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:58.038041 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-77f425ce-773f-49a3-9250-4bffabd39a97 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:58.043851 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-77f425ce-773f-49a3-9250-4bffabd39a97 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:58.044299 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-77f425ce-773f-49a3-9250-4bffabd39a97 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:58.045057 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-77f425ce-773f-49a3-9250-4bffabd39a97 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:58.045486 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-77f425ce-773f-49a3-9250-4bffabd39a97 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:58.169141 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-77f425ce-773f-49a3-9250-4bffabd39a97 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:58.177277 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-77f425ce-773f-49a3-9250-4bffabd39a97 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.144110 Jul 28 03:44:58.177833 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 390/771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:58 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:59.194184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d473962c-869b-444e-878c-374856f00b7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:59.194791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d473962c-869b-444e-878c-374856f00b7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:44:59.200572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d473962c-869b-444e-878c-374856f00b7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:59.201018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d473962c-869b-444e-878c-374856f00b7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:59.201778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d473962c-869b-444e-878c-374856f00b7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:44:59.202212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d473962c-869b-444e-878c-374856f00b7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:44:59.323234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d473962c-869b-444e-878c-374856f00b7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:59.330392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d473962c-869b-444e-878c-374856f00b7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139939 Jul 28 03:44:59.330946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 382/772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:44:59 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:00.347190 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-075e2c00-6618-4e97-8c5b-39a37bf46c4c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:00.348146 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-075e2c00-6618-4e97-8c5b-39a37bf46c4c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:00.353795 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-075e2c00-6618-4e97-8c5b-39a37bf46c4c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:00.354237 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-075e2c00-6618-4e97-8c5b-39a37bf46c4c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:00.354998 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-075e2c00-6618-4e97-8c5b-39a37bf46c4c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:00.355427 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-075e2c00-6618-4e97-8c5b-39a37bf46c4c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:00.472545 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-075e2c00-6618-4e97-8c5b-39a37bf46c4c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:00.479691 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-075e2c00-6618-4e97-8c5b-39a37bf46c4c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.136144 Jul 28 03:45:00.480266 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 391/773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:00 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:01.496631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ec9d06c7-691b-4951-b3ef-d3c40f43ffc3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:01.497152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ec9d06c7-691b-4951-b3ef-d3c40f43ffc3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:01.503188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec9d06c7-691b-4951-b3ef-d3c40f43ffc3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:01.503634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec9d06c7-691b-4951-b3ef-d3c40f43ffc3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:01.505162 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec9d06c7-691b-4951-b3ef-d3c40f43ffc3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:01.505597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec9d06c7-691b-4951-b3ef-d3c40f43ffc3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:01.622531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ec9d06c7-691b-4951-b3ef-d3c40f43ffc3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:01.630503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ec9d06c7-691b-4951-b3ef-d3c40f43ffc3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137586 Jul 28 03:45:01.631054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 383/774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:01 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:02.648068 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-34715ac9-e45c-4753-89b4-46cb4b8b43b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:02.648686 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-34715ac9-e45c-4753-89b4-46cb4b8b43b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:02.654494 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-34715ac9-e45c-4753-89b4-46cb4b8b43b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:02.654937 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-34715ac9-e45c-4753-89b4-46cb4b8b43b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:02.655697 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-34715ac9-e45c-4753-89b4-46cb4b8b43b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:02.656152 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-34715ac9-e45c-4753-89b4-46cb4b8b43b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:02.776093 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-34715ac9-e45c-4753-89b4-46cb4b8b43b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:02.783435 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-34715ac9-e45c-4753-89b4-46cb4b8b43b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139573 Jul 28 03:45:02.784026 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 392/775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:02 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:03.800605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7e6dfc05-6f7f-4459-9d16-fac6101365a4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:03.801812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7e6dfc05-6f7f-4459-9d16-fac6101365a4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:03.807913 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e6dfc05-6f7f-4459-9d16-fac6101365a4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:03.808371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e6dfc05-6f7f-4459-9d16-fac6101365a4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:03.809144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e6dfc05-6f7f-4459-9d16-fac6101365a4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:03.809589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e6dfc05-6f7f-4459-9d16-fac6101365a4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:03.926705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7e6dfc05-6f7f-4459-9d16-fac6101365a4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:03.934105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7e6dfc05-6f7f-4459-9d16-fac6101365a4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137187 Jul 28 03:45:03.934662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 384/776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:03 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:04.950937 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5645987a-dea2-46b2-84fd-988c34e256e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:04.951545 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5645987a-dea2-46b2-84fd-988c34e256e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:04.958108 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5645987a-dea2-46b2-84fd-988c34e256e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:04.958570 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5645987a-dea2-46b2-84fd-988c34e256e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:04.959335 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5645987a-dea2-46b2-84fd-988c34e256e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:04.959785 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5645987a-dea2-46b2-84fd-988c34e256e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:05.085622 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5645987a-dea2-46b2-84fd-988c34e256e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:05.092850 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5645987a-dea2-46b2-84fd-988c34e256e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.145478 Jul 28 03:45:05.093412 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 393/777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:04 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:06.111376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-03a9317f-eb6a-4a4e-9ace-e38f7359b6f9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:06.112029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-03a9317f-eb6a-4a4e-9ace-e38f7359b6f9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:06.118317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03a9317f-eb6a-4a4e-9ace-e38f7359b6f9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:06.118771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03a9317f-eb6a-4a4e-9ace-e38f7359b6f9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:06.119542 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03a9317f-eb6a-4a4e-9ace-e38f7359b6f9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:06.120002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03a9317f-eb6a-4a4e-9ace-e38f7359b6f9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:06.247366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-03a9317f-eb6a-4a4e-9ace-e38f7359b6f9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:06.255120 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-03a9317f-eb6a-4a4e-9ace-e38f7359b6f9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.147299 Jul 28 03:45:06.255677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 385/778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:06 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:07.271328 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-be7ffe83-c464-4c59-9e7d-7009023969fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:07.271966 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-be7ffe83-c464-4c59-9e7d-7009023969fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:07.277667 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-be7ffe83-c464-4c59-9e7d-7009023969fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:07.278119 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-be7ffe83-c464-4c59-9e7d-7009023969fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:07.278886 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-be7ffe83-c464-4c59-9e7d-7009023969fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:07.279318 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-be7ffe83-c464-4c59-9e7d-7009023969fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:07.397005 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-be7ffe83-c464-4c59-9e7d-7009023969fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:07.404291 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-be7ffe83-c464-4c59-9e7d-7009023969fb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.136596 Jul 28 03:45:07.404854 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 394/779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:07 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:08.421753 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cdaf77dc-c39d-4f5c-a801-818a0a1686b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:08.422293 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cdaf77dc-c39d-4f5c-a801-818a0a1686b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:08.428498 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cdaf77dc-c39d-4f5c-a801-818a0a1686b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:08.428942 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cdaf77dc-c39d-4f5c-a801-818a0a1686b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:08.429699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cdaf77dc-c39d-4f5c-a801-818a0a1686b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:08.430125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cdaf77dc-c39d-4f5c-a801-818a0a1686b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:08.548838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cdaf77dc-c39d-4f5c-a801-818a0a1686b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:08.556628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cdaf77dc-c39d-4f5c-a801-818a0a1686b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138508 Jul 28 03:45:08.557185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 386/780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:08 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:09.573283 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-2bde4eac-3f05-475b-a28f-f06bc5e44235 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:09.573927 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-2bde4eac-3f05-475b-a28f-f06bc5e44235 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:09.579676 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2bde4eac-3f05-475b-a28f-f06bc5e44235 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:09.580157 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2bde4eac-3f05-475b-a28f-f06bc5e44235 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:09.580919 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2bde4eac-3f05-475b-a28f-f06bc5e44235 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:09.581348 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-2bde4eac-3f05-475b-a28f-f06bc5e44235 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:09.698872 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-2bde4eac-3f05-475b-a28f-f06bc5e44235 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:09.706125 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-2bde4eac-3f05-475b-a28f-f06bc5e44235 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.136468 Jul 28 03:45:09.706672 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 395/781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:09 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:10.724192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a4d17341-9691-46e5-9ada-73178ad11e50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:10.724705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a4d17341-9691-46e5-9ada-73178ad11e50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:10.730427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4d17341-9691-46e5-9ada-73178ad11e50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:10.730874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4d17341-9691-46e5-9ada-73178ad11e50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:10.731627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4d17341-9691-46e5-9ada-73178ad11e50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:10.732079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4d17341-9691-46e5-9ada-73178ad11e50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:10.851021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4d17341-9691-46e5-9ada-73178ad11e50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:10.858203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a4d17341-9691-46e5-9ada-73178ad11e50 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138358 Jul 28 03:45:10.858758 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 387/782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:10 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:11.875922 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-f7cfb7a2-ad4b-49a1-b629-1c7947f58abf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:11.876533 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-f7cfb7a2-ad4b-49a1-b629-1c7947f58abf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:11.882542 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f7cfb7a2-ad4b-49a1-b629-1c7947f58abf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:11.882988 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f7cfb7a2-ad4b-49a1-b629-1c7947f58abf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:11.883778 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f7cfb7a2-ad4b-49a1-b629-1c7947f58abf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:11.884215 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-f7cfb7a2-ad4b-49a1-b629-1c7947f58abf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:12.005844 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-f7cfb7a2-ad4b-49a1-b629-1c7947f58abf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:12.013061 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-f7cfb7a2-ad4b-49a1-b629-1c7947f58abf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140799 Jul 28 03:45:12.013613 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 396/783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:11 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:13.030785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-14ff3a07-fa29-4796-8191-05d92f137348 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:13.031397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-14ff3a07-fa29-4796-8191-05d92f137348 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:13.038335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14ff3a07-fa29-4796-8191-05d92f137348 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:13.038779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14ff3a07-fa29-4796-8191-05d92f137348 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:13.039540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14ff3a07-fa29-4796-8191-05d92f137348 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:13.040010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14ff3a07-fa29-4796-8191-05d92f137348 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:13.164590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-14ff3a07-fa29-4796-8191-05d92f137348 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:13.171820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-14ff3a07-fa29-4796-8191-05d92f137348 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.144996 Jul 28 03:45:13.172377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 388/784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:13 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:14.189433 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-5c4346aa-4109-4034-acab-afd91ba74bed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:14.190045 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-5c4346aa-4109-4034-acab-afd91ba74bed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:14.196085 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5c4346aa-4109-4034-acab-afd91ba74bed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:14.196537 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5c4346aa-4109-4034-acab-afd91ba74bed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:14.197307 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5c4346aa-4109-4034-acab-afd91ba74bed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:14.197744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-5c4346aa-4109-4034-acab-afd91ba74bed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:14.327226 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-5c4346aa-4109-4034-acab-afd91ba74bed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:14.336170 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-5c4346aa-4109-4034-acab-afd91ba74bed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.150371 Jul 28 03:45:14.336730 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 397/785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:14 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:15.355155 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6077942c-1f03-4ed5-8d3b-f9b49c6b6746 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:15.355800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6077942c-1f03-4ed5-8d3b-f9b49c6b6746 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:15.361562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6077942c-1f03-4ed5-8d3b-f9b49c6b6746 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:15.362013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6077942c-1f03-4ed5-8d3b-f9b49c6b6746 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:15.362787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6077942c-1f03-4ed5-8d3b-f9b49c6b6746 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:15.363298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6077942c-1f03-4ed5-8d3b-f9b49c6b6746 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:15.481040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6077942c-1f03-4ed5-8d3b-f9b49c6b6746 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:15.488571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6077942c-1f03-4ed5-8d3b-f9b49c6b6746 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.136890 Jul 28 03:45:15.489132 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 389/786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:15 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:16.505987 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c9c3f3dd-1211-4736-94ab-4a8107a463f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:16.506590 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c9c3f3dd-1211-4736-94ab-4a8107a463f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:16.512532 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9c3f3dd-1211-4736-94ab-4a8107a463f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:16.512962 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9c3f3dd-1211-4736-94ab-4a8107a463f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:16.513717 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9c3f3dd-1211-4736-94ab-4a8107a463f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:16.514140 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c9c3f3dd-1211-4736-94ab-4a8107a463f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:16.634340 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c9c3f3dd-1211-4736-94ab-4a8107a463f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:16.642002 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c9c3f3dd-1211-4736-94ab-4a8107a463f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140100 Jul 28 03:45:16.652148 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 398/787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:16 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:17.658638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b0d2e90d-5d07-4375-8c82-5d56678e0afd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:17.659269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b0d2e90d-5d07-4375-8c82-5d56678e0afd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:17.665765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0d2e90d-5d07-4375-8c82-5d56678e0afd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:17.666213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0d2e90d-5d07-4375-8c82-5d56678e0afd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:17.666980 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0d2e90d-5d07-4375-8c82-5d56678e0afd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:17.667411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0d2e90d-5d07-4375-8c82-5d56678e0afd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:17.793297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b0d2e90d-5d07-4375-8c82-5d56678e0afd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:17.803834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b0d2e90d-5d07-4375-8c82-5d56678e0afd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.148786 Jul 28 03:45:17.804438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 390/788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:17 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:18.820888 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-262f4d70-2278-4efd-984a-20b2fd88cf60 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:18.821505 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-262f4d70-2278-4efd-984a-20b2fd88cf60 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:18.827207 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-262f4d70-2278-4efd-984a-20b2fd88cf60 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:18.827656 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-262f4d70-2278-4efd-984a-20b2fd88cf60 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:18.828482 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-262f4d70-2278-4efd-984a-20b2fd88cf60 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:18.828916 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-262f4d70-2278-4efd-984a-20b2fd88cf60 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:18.953194 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-262f4d70-2278-4efd-984a-20b2fd88cf60 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:18.961869 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-262f4d70-2278-4efd-984a-20b2fd88cf60 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.144434 Jul 28 03:45:18.962369 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 399/789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:18 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:19.978551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cd750587-63db-4353-b46a-887acd5c9439 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:19.979166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cd750587-63db-4353-b46a-887acd5c9439 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:19.984883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd750587-63db-4353-b46a-887acd5c9439 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:19.985332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd750587-63db-4353-b46a-887acd5c9439 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:19.986096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd750587-63db-4353-b46a-887acd5c9439 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:19.986525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd750587-63db-4353-b46a-887acd5c9439 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:20.107725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cd750587-63db-4353-b46a-887acd5c9439 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:20.115111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cd750587-63db-4353-b46a-887acd5c9439 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140222 Jul 28 03:45:20.115665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 391/790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:19 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:21.131596 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-c4bb621b-eaf1-4e00-9aa8-0f7783297d0c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:21.132240 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-c4bb621b-eaf1-4e00-9aa8-0f7783297d0c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:21.138151 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c4bb621b-eaf1-4e00-9aa8-0f7783297d0c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:21.138600 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c4bb621b-eaf1-4e00-9aa8-0f7783297d0c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:21.139369 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c4bb621b-eaf1-4e00-9aa8-0f7783297d0c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:21.139825 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-c4bb621b-eaf1-4e00-9aa8-0f7783297d0c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:21.257832 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-c4bb621b-eaf1-4e00-9aa8-0f7783297d0c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:21.265032 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-c4bb621b-eaf1-4e00-9aa8-0f7783297d0c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137207 Jul 28 03:45:21.265586 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 400/791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:21 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:22.282256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5127ca30-f8a1-4128-9713-beca95881141 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:22.282861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5127ca30-f8a1-4128-9713-beca95881141 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:22.288770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5127ca30-f8a1-4128-9713-beca95881141 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:22.289215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5127ca30-f8a1-4128-9713-beca95881141 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:22.289971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5127ca30-f8a1-4128-9713-beca95881141 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:22.290401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5127ca30-f8a1-4128-9713-beca95881141 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:22.408825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5127ca30-f8a1-4128-9713-beca95881141 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:22.416693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5127ca30-f8a1-4128-9713-beca95881141 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138109 Jul 28 03:45:22.417248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 392/792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:22 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:23.434069 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-d5a04f0d-79c6-4309-9b97-b209fe5b126f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:23.434597 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-d5a04f0d-79c6-4309-9b97-b209fe5b126f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:23.440357 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5a04f0d-79c6-4309-9b97-b209fe5b126f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:23.440796 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5a04f0d-79c6-4309-9b97-b209fe5b126f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:23.442140 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5a04f0d-79c6-4309-9b97-b209fe5b126f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:23.442570 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-d5a04f0d-79c6-4309-9b97-b209fe5b126f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:23.560505 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-d5a04f0d-79c6-4309-9b97-b209fe5b126f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:23.568271 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-d5a04f0d-79c6-4309-9b97-b209fe5b126f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137902 Jul 28 03:45:23.568823 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 401/793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:23 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:24.585784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c3dcc533-3634-4102-a4f8-3656494d0af5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:24.586402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c3dcc533-3634-4102-a4f8-3656494d0af5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:24.592207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3dcc533-3634-4102-a4f8-3656494d0af5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:24.592658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3dcc533-3634-4102-a4f8-3656494d0af5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:24.593431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3dcc533-3634-4102-a4f8-3656494d0af5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:24.593865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3dcc533-3634-4102-a4f8-3656494d0af5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:24.712464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c3dcc533-3634-4102-a4f8-3656494d0af5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:24.719647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c3dcc533-3634-4102-a4f8-3656494d0af5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138080 Jul 28 03:45:24.720227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 393/794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:24 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:25.737334 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-689cab92-7bf5-41fd-b020-ccf6e8c794b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:25.737859 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-689cab92-7bf5-41fd-b020-ccf6e8c794b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:25.744513 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-689cab92-7bf5-41fd-b020-ccf6e8c794b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:25.744957 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-689cab92-7bf5-41fd-b020-ccf6e8c794b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:25.745708 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-689cab92-7bf5-41fd-b020-ccf6e8c794b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:25.746133 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-689cab92-7bf5-41fd-b020-ccf6e8c794b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:25.868308 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-689cab92-7bf5-41fd-b020-ccf6e8c794b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:25.875624 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-689cab92-7bf5-41fd-b020-ccf6e8c794b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.142149 Jul 28 03:45:25.876203 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 402/795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:25 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:26.892715 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-945ec6cb-618f-49ca-809b-2dfaed6f3c82 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:26.893333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-945ec6cb-618f-49ca-809b-2dfaed6f3c82 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:26.899847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-945ec6cb-618f-49ca-809b-2dfaed6f3c82 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:26.900303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-945ec6cb-618f-49ca-809b-2dfaed6f3c82 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:26.901076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-945ec6cb-618f-49ca-809b-2dfaed6f3c82 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:26.901514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-945ec6cb-618f-49ca-809b-2dfaed6f3c82 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:27.023956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-945ec6cb-618f-49ca-809b-2dfaed6f3c82 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:27.031240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-945ec6cb-618f-49ca-809b-2dfaed6f3c82 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.142193 Jul 28 03:45:27.032007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 394/796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:26 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:28.048455 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-8dd412ad-61b3-4d0f-998f-343270acbb7f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:28.048998 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-8dd412ad-61b3-4d0f-998f-343270acbb7f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:28.054898 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8dd412ad-61b3-4d0f-998f-343270acbb7f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:28.055343 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8dd412ad-61b3-4d0f-998f-343270acbb7f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:28.056141 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8dd412ad-61b3-4d0f-998f-343270acbb7f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:28.056573 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-8dd412ad-61b3-4d0f-998f-343270acbb7f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:28.174959 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-8dd412ad-61b3-4d0f-998f-343270acbb7f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:28.182376 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-8dd412ad-61b3-4d0f-998f-343270acbb7f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137679 Jul 28 03:45:28.182924 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 403/797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:28 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:29.199494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7f2f60c1-705c-4679-92bf-2ebe316a4aa3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:29.200134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7f2f60c1-705c-4679-92bf-2ebe316a4aa3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:29.205928 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f2f60c1-705c-4679-92bf-2ebe316a4aa3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:29.206372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f2f60c1-705c-4679-92bf-2ebe316a4aa3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:29.207139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f2f60c1-705c-4679-92bf-2ebe316a4aa3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:29.207582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f2f60c1-705c-4679-92bf-2ebe316a4aa3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:29.328336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7f2f60c1-705c-4679-92bf-2ebe316a4aa3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:29.335551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7f2f60c1-705c-4679-92bf-2ebe316a4aa3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139719 Jul 28 03:45:29.336214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 395/798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:29 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:30.353058 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.api.openstack.wsgi [None req-31f6c89f-0535-4eaf-90e8-0c86bc4c5163 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:30.353784 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.compute.api [None req-31f6c89f-0535-4eaf-90e8-0c86bc4c5163 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119155) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:30.359343 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-31f6c89f-0535-4eaf-90e8-0c86bc4c5163 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:30.359806 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-31f6c89f-0535-4eaf-90e8-0c86bc4c5163 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:30.360570 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-31f6c89f-0535-4eaf-90e8-0c86bc4c5163 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:30.361004 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG oslo_concurrency.lockutils [None req-31f6c89f-0535-4eaf-90e8-0c86bc4c5163 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:30.484254 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: DEBUG nova.policy [None req-31f6c89f-0535-4eaf-90e8-0c86bc4c5163 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119155) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:30.491879 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO nova.api.openstack.requestlog [None req-31f6c89f-0535-4eaf-90e8-0c86bc4c5163 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.142407 Jul 28 03:45:30.492541 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: [pid: 119155|app: 0|req: 404/799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:30 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:31.508697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1c893419-9ddd-42e3-a785-5be9b3d20c00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:31.509832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1c893419-9ddd-42e3-a785-5be9b3d20c00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:45:31.513160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 03:45:31.516245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1c893419-9ddd-42e3-a785-5be9b3d20c00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:31.516693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1c893419-9ddd-42e3-a785-5be9b3d20c00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:31.517469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1c893419-9ddd-42e3-a785-5be9b3d20c00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:45:31.517905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1c893419-9ddd-42e3-a785-5be9b3d20c00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:45:31.638304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1c893419-9ddd-42e3-a785-5be9b3d20c00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:31.645946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1c893419-9ddd-42e3-a785-5be9b3d20c00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140889 Jul 28 03:45:31.646512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 396/800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:45:31 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:32.659090 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:45:32.662422 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: Wed Jul 28 03:45:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e (ip 10.222.0.16) !!! Jul 28 03:45:34.975183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:45:34.975696 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 03:45:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 03:45:47.398305 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:45:47.398902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 03:45:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 03:46:32.733667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-11ac10e4-6f4b-4158-b2ef-e032e3c4c173 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:32.734278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-11ac10e4-6f4b-4158-b2ef-e032e3c4c173 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:32.741173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11ac10e4-6f4b-4158-b2ef-e032e3c4c173 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:32.741618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11ac10e4-6f4b-4158-b2ef-e032e3c4c173 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:32.742392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11ac10e4-6f4b-4158-b2ef-e032e3c4c173 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:32.742820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11ac10e4-6f4b-4158-b2ef-e032e3c4c173 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:32.748527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60668. Jul 28 03:46:32.867185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-11ac10e4-6f4b-4158-b2ef-e032e3c4c173 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:32.874386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-11ac10e4-6f4b-4158-b2ef-e032e3c4c173 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.156008 Jul 28 03:46:32.874931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 397/801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:32 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:33.891335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fae5a4aa-787a-43e6-8d64-278011112677 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:33.891994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fae5a4aa-787a-43e6-8d64-278011112677 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:33.897808 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fae5a4aa-787a-43e6-8d64-278011112677 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:33.898252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fae5a4aa-787a-43e6-8d64-278011112677 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:33.899015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fae5a4aa-787a-43e6-8d64-278011112677 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:33.899459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fae5a4aa-787a-43e6-8d64-278011112677 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:34.018079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fae5a4aa-787a-43e6-8d64-278011112677 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:34.026033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fae5a4aa-787a-43e6-8d64-278011112677 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138370 Jul 28 03:46:34.026593 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 398/802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:33 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:35.043629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2fa33320-9387-4eec-a422-f41395cf69a3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:35.044293 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2fa33320-9387-4eec-a422-f41395cf69a3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:35.049858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2fa33320-9387-4eec-a422-f41395cf69a3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:35.050302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2fa33320-9387-4eec-a422-f41395cf69a3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:35.051561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2fa33320-9387-4eec-a422-f41395cf69a3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:35.052013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2fa33320-9387-4eec-a422-f41395cf69a3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:35.170968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2fa33320-9387-4eec-a422-f41395cf69a3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:35.179164 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2fa33320-9387-4eec-a422-f41395cf69a3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139189 Jul 28 03:46:35.179753 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 399/803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:35 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:36.196254 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8bbcca4d-42a0-481d-a9ba-b4bd68c6f6f5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:36.196858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8bbcca4d-42a0-481d-a9ba-b4bd68c6f6f5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:36.202581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8bbcca4d-42a0-481d-a9ba-b4bd68c6f6f5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:36.203019 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8bbcca4d-42a0-481d-a9ba-b4bd68c6f6f5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:36.203790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8bbcca4d-42a0-481d-a9ba-b4bd68c6f6f5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:36.204218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8bbcca4d-42a0-481d-a9ba-b4bd68c6f6f5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:36.325028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8bbcca4d-42a0-481d-a9ba-b4bd68c6f6f5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:36.332588 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8bbcca4d-42a0-481d-a9ba-b4bd68c6f6f5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139437 Jul 28 03:46:36.333130 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 400/804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:36 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:37.350476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-817d1e36-7b91-42c1-9352-a6b44840feca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:37.351739 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-817d1e36-7b91-42c1-9352-a6b44840feca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:37.357515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-817d1e36-7b91-42c1-9352-a6b44840feca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:37.357959 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-817d1e36-7b91-42c1-9352-a6b44840feca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:37.358717 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-817d1e36-7b91-42c1-9352-a6b44840feca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:37.359147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-817d1e36-7b91-42c1-9352-a6b44840feca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:37.477933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-817d1e36-7b91-42c1-9352-a6b44840feca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:37.485055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-817d1e36-7b91-42c1-9352-a6b44840feca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138495 Jul 28 03:46:37.485602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 401/805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:37 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:38.501919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ce835c57-c4e8-43d6-84b5-0899a2f9c800 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:38.502535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ce835c57-c4e8-43d6-84b5-0899a2f9c800 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:38.508330 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce835c57-c4e8-43d6-84b5-0899a2f9c800 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:38.508770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce835c57-c4e8-43d6-84b5-0899a2f9c800 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:38.509523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce835c57-c4e8-43d6-84b5-0899a2f9c800 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:38.509985 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce835c57-c4e8-43d6-84b5-0899a2f9c800 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:38.630422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ce835c57-c4e8-43d6-84b5-0899a2f9c800 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:38.636357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ce835c57-c4e8-43d6-84b5-0899a2f9c800 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138093 Jul 28 03:46:38.636911 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 402/806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:38 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:39.653967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-91fbcb88-71de-4df2-ae2d-c9fbc8078458 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:39.654586 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-91fbcb88-71de-4df2-ae2d-c9fbc8078458 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:39.660718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-91fbcb88-71de-4df2-ae2d-c9fbc8078458 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:39.661170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-91fbcb88-71de-4df2-ae2d-c9fbc8078458 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:39.661945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-91fbcb88-71de-4df2-ae2d-c9fbc8078458 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:39.662380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-91fbcb88-71de-4df2-ae2d-c9fbc8078458 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:39.785756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-91fbcb88-71de-4df2-ae2d-c9fbc8078458 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:39.792853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-91fbcb88-71de-4df2-ae2d-c9fbc8078458 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.142500 Jul 28 03:46:39.793399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 403/807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:39 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:40.809961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-082dba0c-20db-460d-84f3-eb1c0498289f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:40.811292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-082dba0c-20db-460d-84f3-eb1c0498289f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:40.817758 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-082dba0c-20db-460d-84f3-eb1c0498289f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:40.818265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-082dba0c-20db-460d-84f3-eb1c0498289f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:40.819039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-082dba0c-20db-460d-84f3-eb1c0498289f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:40.819477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-082dba0c-20db-460d-84f3-eb1c0498289f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:40.945667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-082dba0c-20db-460d-84f3-eb1c0498289f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:40.953086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-082dba0c-20db-460d-84f3-eb1c0498289f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.146747 Jul 28 03:46:40.953635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 404/808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:40 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:41.969858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fa83c1a3-2f63-4dfb-8f45-5d02a47fed21 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:41.970450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fa83c1a3-2f63-4dfb-8f45-5d02a47fed21 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:41.977315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa83c1a3-2f63-4dfb-8f45-5d02a47fed21 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:41.977898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa83c1a3-2f63-4dfb-8f45-5d02a47fed21 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:41.978705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa83c1a3-2f63-4dfb-8f45-5d02a47fed21 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:41.979169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa83c1a3-2f63-4dfb-8f45-5d02a47fed21 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:42.099191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fa83c1a3-2f63-4dfb-8f45-5d02a47fed21 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:42.106353 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fa83c1a3-2f63-4dfb-8f45-5d02a47fed21 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140124 Jul 28 03:46:42.106895 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 405/809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:41 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:42.206472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dfdc6365-6d5e-4fec-8e23-d49d4278894b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:42.206964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dfdc6365-6d5e-4fec-8e23-d49d4278894b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:42.212809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfdc6365-6d5e-4fec-8e23-d49d4278894b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:42.213249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfdc6365-6d5e-4fec-8e23-d49d4278894b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:42.214000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfdc6365-6d5e-4fec-8e23-d49d4278894b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:42.214429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfdc6365-6d5e-4fec-8e23-d49d4278894b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:42.298259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-dfdc6365-6d5e-4fec-8e23-d49d4278894b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lazy-loading 'services' on Instance uuid 6defc507-3456-460c-94f0-1d954af7997d {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:46:42.386503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dfdc6365-6d5e-4fec-8e23-d49d4278894b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [da3095e9-1d95-4b16-970a-64789ea5f291] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 03:46:43.406844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [None req-dfdc6365-6d5e-4fec-8e23-d49d4278894b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [da3095e9-1d95-4b16-970a-64789ea5f291] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60816. Jul 28 03:46:43.412978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dfdc6365-6d5e-4fec-8e23-d49d4278894b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d/os-volume_attachments/ae576153-1647-46b6-9af2-7be9913ff5b7" status: 202 len: 0 microversion: 2.1 time: 1.209471 Jul 28 03:46:43.417707 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 406/810] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Jul 28 03:46:42 2021] DELETE /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d/os-volume_attachments/ae576153-1647-46b6-9af2-7be9913ff5b7 => generated 0 bytes in 1215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:46:43.431098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-aa7bbbf8-1ce9-4364-b912-49cde03eafea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:43.432674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-aa7bbbf8-1ce9-4364-b912-49cde03eafea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:43.441659 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa7bbbf8-1ce9-4364-b912-49cde03eafea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:43.442636 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa7bbbf8-1ce9-4364-b912-49cde03eafea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:43.444452 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa7bbbf8-1ce9-4364-b912-49cde03eafea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:43.444891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa7bbbf8-1ce9-4364-b912-49cde03eafea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:43.626659 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-aa7bbbf8-1ce9-4364-b912-49cde03eafea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:43.636795 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-aa7bbbf8-1ce9-4364-b912-49cde03eafea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.217446 Jul 28 03:46:43.637445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 407/811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:43 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:44.653642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b3dc06e7-1401-43df-ad41-b418ed349e86 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:44.654409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b3dc06e7-1401-43df-ad41-b418ed349e86 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:44.660759 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b3dc06e7-1401-43df-ad41-b418ed349e86 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:44.661209 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b3dc06e7-1401-43df-ad41-b418ed349e86 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:44.661982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b3dc06e7-1401-43df-ad41-b418ed349e86 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:44.662420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b3dc06e7-1401-43df-ad41-b418ed349e86 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:44.856855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b3dc06e7-1401-43df-ad41-b418ed349e86 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:44.864339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b3dc06e7-1401-43df-ad41-b418ed349e86 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.214514 Jul 28 03:46:44.865136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 408/812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:44 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:45.881747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-995298c1-6a3a-4f48-a8f6-d0f9b1ceed65 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:45.882363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-995298c1-6a3a-4f48-a8f6-d0f9b1ceed65 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:45.888106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-995298c1-6a3a-4f48-a8f6-d0f9b1ceed65 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:45.888550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-995298c1-6a3a-4f48-a8f6-d0f9b1ceed65 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:45.889307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-995298c1-6a3a-4f48-a8f6-d0f9b1ceed65 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:45.889729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-995298c1-6a3a-4f48-a8f6-d0f9b1ceed65 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:46.008320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-995298c1-6a3a-4f48-a8f6-d0f9b1ceed65 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:46.015591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-995298c1-6a3a-4f48-a8f6-d0f9b1ceed65 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138041 Jul 28 03:46:46.016183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 409/813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:45 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:47.032748 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d379f25a-770f-40fb-b70b-42a4759e35ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:47.033375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d379f25a-770f-40fb-b70b-42a4759e35ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:47.039797 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d379f25a-770f-40fb-b70b-42a4759e35ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:47.040250 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d379f25a-770f-40fb-b70b-42a4759e35ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:47.041014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d379f25a-770f-40fb-b70b-42a4759e35ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:47.041453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d379f25a-770f-40fb-b70b-42a4759e35ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:47.164186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d379f25a-770f-40fb-b70b-42a4759e35ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:47.171479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d379f25a-770f-40fb-b70b-42a4759e35ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.142360 Jul 28 03:46:47.172065 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 410/814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:47 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:48.188514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1a62bad3-0bd8-4356-9e9c-9b5b3cffc8c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:48.189142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1a62bad3-0bd8-4356-9e9c-9b5b3cffc8c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:48.194874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1a62bad3-0bd8-4356-9e9c-9b5b3cffc8c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:48.195322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1a62bad3-0bd8-4356-9e9c-9b5b3cffc8c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:48.196116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1a62bad3-0bd8-4356-9e9c-9b5b3cffc8c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:48.196552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1a62bad3-0bd8-4356-9e9c-9b5b3cffc8c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:48.315962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1a62bad3-0bd8-4356-9e9c-9b5b3cffc8c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:48.323556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1a62bad3-0bd8-4356-9e9c-9b5b3cffc8c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138676 Jul 28 03:46:48.324128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 411/815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:48 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:49.340307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9538752c-7306-4929-8e1e-22cc9917626e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:49.340985 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9538752c-7306-4929-8e1e-22cc9917626e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:49.346561 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9538752c-7306-4929-8e1e-22cc9917626e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:49.347007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9538752c-7306-4929-8e1e-22cc9917626e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:49.348683 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9538752c-7306-4929-8e1e-22cc9917626e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:49.349106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9538752c-7306-4929-8e1e-22cc9917626e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:49.469558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9538752c-7306-4929-8e1e-22cc9917626e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:49.477164 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9538752c-7306-4929-8e1e-22cc9917626e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140500 Jul 28 03:46:49.477711 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 412/816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:49 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:50.495040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-93f7fe6e-6234-488d-b1cc-6b2c62232274 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:50.495760 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-93f7fe6e-6234-488d-b1cc-6b2c62232274 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:50.501481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93f7fe6e-6234-488d-b1cc-6b2c62232274 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:50.501927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93f7fe6e-6234-488d-b1cc-6b2c62232274 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:50.502679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93f7fe6e-6234-488d-b1cc-6b2c62232274 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:50.503106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93f7fe6e-6234-488d-b1cc-6b2c62232274 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:50.624647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-93f7fe6e-6234-488d-b1cc-6b2c62232274 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:50.632731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-93f7fe6e-6234-488d-b1cc-6b2c62232274 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.141690 Jul 28 03:46:50.633291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 413/817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:50 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:51.649004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6b5ff4f4-6379-4c12-804c-8396238231e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:51.649621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6b5ff4f4-6379-4c12-804c-8396238231e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:51.655353 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b5ff4f4-6379-4c12-804c-8396238231e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:51.655825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b5ff4f4-6379-4c12-804c-8396238231e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:51.656583 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b5ff4f4-6379-4c12-804c-8396238231e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:51.657009 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b5ff4f4-6379-4c12-804c-8396238231e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:51.775197 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6b5ff4f4-6379-4c12-804c-8396238231e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:51.782394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6b5ff4f4-6379-4c12-804c-8396238231e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137144 Jul 28 03:46:51.782950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 414/818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:51 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:52.799734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9276502b-d96d-40b8-b8a3-a4babb0bc436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:52.800886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9276502b-d96d-40b8-b8a3-a4babb0bc436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:52.806675 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9276502b-d96d-40b8-b8a3-a4babb0bc436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:52.807151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9276502b-d96d-40b8-b8a3-a4babb0bc436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:52.807942 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9276502b-d96d-40b8-b8a3-a4babb0bc436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:52.808378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9276502b-d96d-40b8-b8a3-a4babb0bc436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:52.928442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9276502b-d96d-40b8-b8a3-a4babb0bc436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:52.935827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9276502b-d96d-40b8-b8a3-a4babb0bc436 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139693 Jul 28 03:46:52.936387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 415/819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:52 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:53.953214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-28186d5c-6474-448b-91b9-35c71cea58df tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:53.953819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-28186d5c-6474-448b-91b9-35c71cea58df tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:53.960452 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28186d5c-6474-448b-91b9-35c71cea58df tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:53.960905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28186d5c-6474-448b-91b9-35c71cea58df tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:53.961706 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28186d5c-6474-448b-91b9-35c71cea58df tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:53.962143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28186d5c-6474-448b-91b9-35c71cea58df tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:54.318194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-28186d5c-6474-448b-91b9-35c71cea58df tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:54.325903 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-28186d5c-6474-448b-91b9-35c71cea58df tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.376367 Jul 28 03:46:54.326456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 416/820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:53 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:55.344257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0c032c34-26d9-4dad-aa54-40afc2c8b866 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:55.344919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0c032c34-26d9-4dad-aa54-40afc2c8b866 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:55.351039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c032c34-26d9-4dad-aa54-40afc2c8b866 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:55.351482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c032c34-26d9-4dad-aa54-40afc2c8b866 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:55.352259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c032c34-26d9-4dad-aa54-40afc2c8b866 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:55.352687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c032c34-26d9-4dad-aa54-40afc2c8b866 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:55.469825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0c032c34-26d9-4dad-aa54-40afc2c8b866 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:55.477940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0c032c34-26d9-4dad-aa54-40afc2c8b866 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137296 Jul 28 03:46:55.478493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 417/821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:55 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:56.494530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b2abc31b-9e3d-4d21-b9bf-68129048d0ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:56.495144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b2abc31b-9e3d-4d21-b9bf-68129048d0ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:56.500847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2abc31b-9e3d-4d21-b9bf-68129048d0ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:56.501296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2abc31b-9e3d-4d21-b9bf-68129048d0ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:56.502062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2abc31b-9e3d-4d21-b9bf-68129048d0ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:56.502557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2abc31b-9e3d-4d21-b9bf-68129048d0ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:56.619659 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b2abc31b-9e3d-4d21-b9bf-68129048d0ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:56.626789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b2abc31b-9e3d-4d21-b9bf-68129048d0ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.135989 Jul 28 03:46:56.627336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 418/822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:56 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:57.644982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b1737716-bf71-4749-86fe-928497d6fddf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:57.645585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b1737716-bf71-4749-86fe-928497d6fddf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:57.651390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b1737716-bf71-4749-86fe-928497d6fddf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:57.651900 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b1737716-bf71-4749-86fe-928497d6fddf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:57.652691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b1737716-bf71-4749-86fe-928497d6fddf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:57.653122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b1737716-bf71-4749-86fe-928497d6fddf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:57.775811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b1737716-bf71-4749-86fe-928497d6fddf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:57.783160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b1737716-bf71-4749-86fe-928497d6fddf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.142503 Jul 28 03:46:57.783733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 419/823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:57 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:58.800089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c4dddfd8-8e72-4c5a-9189-b0a60b8d4674 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:58.800932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c4dddfd8-8e72-4c5a-9189-b0a60b8d4674 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:58.806387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c4dddfd8-8e72-4c5a-9189-b0a60b8d4674 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:58.806835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c4dddfd8-8e72-4c5a-9189-b0a60b8d4674 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:58.807634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c4dddfd8-8e72-4c5a-9189-b0a60b8d4674 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:58.808098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c4dddfd8-8e72-4c5a-9189-b0a60b8d4674 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:58.926374 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c4dddfd8-8e72-4c5a-9189-b0a60b8d4674 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:58.933562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c4dddfd8-8e72-4c5a-9189-b0a60b8d4674 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137062 Jul 28 03:46:58.934116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 420/824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:58 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:59.950090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9c58a205-9a2a-4d5d-ad02-ba195361452f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:59.950686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9c58a205-9a2a-4d5d-ad02-ba195361452f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:46:59.956401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c58a205-9a2a-4d5d-ad02-ba195361452f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:59.956855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c58a205-9a2a-4d5d-ad02-ba195361452f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:46:59.957597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c58a205-9a2a-4d5d-ad02-ba195361452f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:46:59.958023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c58a205-9a2a-4d5d-ad02-ba195361452f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:00.075252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9c58a205-9a2a-4d5d-ad02-ba195361452f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:00.082448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9c58a205-9a2a-4d5d-ad02-ba195361452f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.135859 Jul 28 03:47:00.082933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 421/825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:46:59 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:01.099656 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ca779cb4-450f-4c2f-ba4c-cb78ae715fe0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:01.100301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ca779cb4-450f-4c2f-ba4c-cb78ae715fe0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:01.106003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca779cb4-450f-4c2f-ba4c-cb78ae715fe0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:01.106448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca779cb4-450f-4c2f-ba4c-cb78ae715fe0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:01.107205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca779cb4-450f-4c2f-ba4c-cb78ae715fe0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:01.107632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca779cb4-450f-4c2f-ba4c-cb78ae715fe0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:01.231925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ca779cb4-450f-4c2f-ba4c-cb78ae715fe0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:01.239643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ca779cb4-450f-4c2f-ba4c-cb78ae715fe0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.144400 Jul 28 03:47:01.240218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 422/826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:01 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:02.256728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-88684732-caa7-48bb-9b11-05053f8e68a5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:02.257345 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-88684732-caa7-48bb-9b11-05053f8e68a5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:02.263023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88684732-caa7-48bb-9b11-05053f8e68a5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:02.263464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88684732-caa7-48bb-9b11-05053f8e68a5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:02.264255 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88684732-caa7-48bb-9b11-05053f8e68a5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:02.264684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88684732-caa7-48bb-9b11-05053f8e68a5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:02.384292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-88684732-caa7-48bb-9b11-05053f8e68a5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:02.391426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-88684732-caa7-48bb-9b11-05053f8e68a5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138840 Jul 28 03:47:02.392072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 423/827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:02 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:03.409163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c737adaa-4beb-4bb8-85ee-1bdcc377b663 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:03.410598 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c737adaa-4beb-4bb8-85ee-1bdcc377b663 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:03.416515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c737adaa-4beb-4bb8-85ee-1bdcc377b663 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:03.417066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c737adaa-4beb-4bb8-85ee-1bdcc377b663 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:03.417724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c737adaa-4beb-4bb8-85ee-1bdcc377b663 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:03.418371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c737adaa-4beb-4bb8-85ee-1bdcc377b663 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:03.539608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c737adaa-4beb-4bb8-85ee-1bdcc377b663 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:03.546878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c737adaa-4beb-4bb8-85ee-1bdcc377b663 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.141469 Jul 28 03:47:03.547431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 424/828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:03 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:04.563830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a97370d4-997d-4425-a36a-78d27ac3b8de tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:04.564430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a97370d4-997d-4425-a36a-78d27ac3b8de tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:04.570339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a97370d4-997d-4425-a36a-78d27ac3b8de tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:04.570786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a97370d4-997d-4425-a36a-78d27ac3b8de tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:04.571559 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a97370d4-997d-4425-a36a-78d27ac3b8de tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:04.572023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a97370d4-997d-4425-a36a-78d27ac3b8de tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:04.692737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a97370d4-997d-4425-a36a-78d27ac3b8de tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:04.699920 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a97370d4-997d-4425-a36a-78d27ac3b8de tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139683 Jul 28 03:47:04.700475 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 425/829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:04 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:05.716938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c5c728b4-d4e4-47d6-b0f6-5b0a5b62078b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:05.717531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c5c728b4-d4e4-47d6-b0f6-5b0a5b62078b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:05.723612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5c728b4-d4e4-47d6-b0f6-5b0a5b62078b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:05.724292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5c728b4-d4e4-47d6-b0f6-5b0a5b62078b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:05.725083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5c728b4-d4e4-47d6-b0f6-5b0a5b62078b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:05.725514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5c728b4-d4e4-47d6-b0f6-5b0a5b62078b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:05.842225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c5c728b4-d4e4-47d6-b0f6-5b0a5b62078b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:05.850308 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c5c728b4-d4e4-47d6-b0f6-5b0a5b62078b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137085 Jul 28 03:47:05.850863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 426/830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:05 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:06.867654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a0505e89-7e46-4db7-a5c8-a3a63c2e70ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:06.868322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a0505e89-7e46-4db7-a5c8-a3a63c2e70ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:06.873999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a0505e89-7e46-4db7-a5c8-a3a63c2e70ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:06.874443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a0505e89-7e46-4db7-a5c8-a3a63c2e70ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:06.875201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a0505e89-7e46-4db7-a5c8-a3a63c2e70ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:06.875627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a0505e89-7e46-4db7-a5c8-a3a63c2e70ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:06.997359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a0505e89-7e46-4db7-a5c8-a3a63c2e70ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:07.004468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a0505e89-7e46-4db7-a5c8-a3a63c2e70ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140923 Jul 28 03:47:07.005637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 427/831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:06 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:08.022195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a2f1738c-fcd3-44b3-a8d3-4faeaf24ebee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:08.022840 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a2f1738c-fcd3-44b3-a8d3-4faeaf24ebee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:08.028809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a2f1738c-fcd3-44b3-a8d3-4faeaf24ebee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:08.029261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a2f1738c-fcd3-44b3-a8d3-4faeaf24ebee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:08.030012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a2f1738c-fcd3-44b3-a8d3-4faeaf24ebee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:08.030441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a2f1738c-fcd3-44b3-a8d3-4faeaf24ebee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:08.154786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a2f1738c-fcd3-44b3-a8d3-4faeaf24ebee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:08.163105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a2f1738c-fcd3-44b3-a8d3-4faeaf24ebee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.144649 Jul 28 03:47:08.163665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 428/832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:08 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:09.181000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4eca23c7-31bb-4d2f-8fca-8e472fcd31b8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:09.181596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4eca23c7-31bb-4d2f-8fca-8e472fcd31b8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:09.187346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eca23c7-31bb-4d2f-8fca-8e472fcd31b8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:09.187826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eca23c7-31bb-4d2f-8fca-8e472fcd31b8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:09.188582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eca23c7-31bb-4d2f-8fca-8e472fcd31b8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:09.189011 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eca23c7-31bb-4d2f-8fca-8e472fcd31b8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:09.309609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4eca23c7-31bb-4d2f-8fca-8e472fcd31b8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:09.317097 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4eca23c7-31bb-4d2f-8fca-8e472fcd31b8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140666 Jul 28 03:47:09.317588 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 429/833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:09 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:10.340566 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-69f393de-f522-4b2c-bba4-a8b992a56a7c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:10.340566 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-69f393de-f522-4b2c-bba4-a8b992a56a7c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:10.345413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-69f393de-f522-4b2c-bba4-a8b992a56a7c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:10.345853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-69f393de-f522-4b2c-bba4-a8b992a56a7c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:10.346618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-69f393de-f522-4b2c-bba4-a8b992a56a7c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:10.347043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-69f393de-f522-4b2c-bba4-a8b992a56a7c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:10.467671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-69f393de-f522-4b2c-bba4-a8b992a56a7c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:10.476010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-69f393de-f522-4b2c-bba4-a8b992a56a7c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.145763 Jul 28 03:47:10.476567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 430/834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:10 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:11.493276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-16a1eb9f-4a2c-4263-b262-4932bdfedc72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:11.493871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-16a1eb9f-4a2c-4263-b262-4932bdfedc72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:11.499557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16a1eb9f-4a2c-4263-b262-4932bdfedc72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:11.500029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16a1eb9f-4a2c-4263-b262-4932bdfedc72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:11.500786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16a1eb9f-4a2c-4263-b262-4932bdfedc72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:11.501212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16a1eb9f-4a2c-4263-b262-4932bdfedc72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:11.622141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-16a1eb9f-4a2c-4263-b262-4932bdfedc72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:11.629397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-16a1eb9f-4a2c-4263-b262-4932bdfedc72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140321 Jul 28 03:47:11.630802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 431/835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:11 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:12.648404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-41aed64b-c42b-4e09-b654-efa5a8e4f968 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:12.649058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-41aed64b-c42b-4e09-b654-efa5a8e4f968 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:12.655162 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41aed64b-c42b-4e09-b654-efa5a8e4f968 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:12.655611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41aed64b-c42b-4e09-b654-efa5a8e4f968 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:12.656407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41aed64b-c42b-4e09-b654-efa5a8e4f968 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:12.656847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41aed64b-c42b-4e09-b654-efa5a8e4f968 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:12.691744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: Traceback (most recent call last): Jul 28 03:47:12.691744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 28 03:47:12.691744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: timer() Jul 28 03:47:12.691744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 28 03:47:12.691744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: cb(*args, **kw) Jul 28 03:47:12.691744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 152, in _do_acquire Jul 28 03:47:12.691744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: waiter.switch() Jul 28 03:47:12.691744 dv-cinder-733062-21-iscsi devstack@n-api.service[119155]: greenlet.error: cannot switch to a different thread Jul 28 03:47:12.775669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-41aed64b-c42b-4e09-b654-efa5a8e4f968 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:12.782793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-41aed64b-c42b-4e09-b654-efa5a8e4f968 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138756 Jul 28 03:47:12.783346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 432/836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:12 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:13.799990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a29edf09-262b-4cbf-87de-e1aff27ee5e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:13.800615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a29edf09-262b-4cbf-87de-e1aff27ee5e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:13.806807 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a29edf09-262b-4cbf-87de-e1aff27ee5e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:13.807257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a29edf09-262b-4cbf-87de-e1aff27ee5e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:13.808058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a29edf09-262b-4cbf-87de-e1aff27ee5e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:13.808495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a29edf09-262b-4cbf-87de-e1aff27ee5e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:13.928248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a29edf09-262b-4cbf-87de-e1aff27ee5e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:13.935386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a29edf09-262b-4cbf-87de-e1aff27ee5e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139145 Jul 28 03:47:13.935987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 433/837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:13 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:14.953939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ddfcf418-0f7c-4f6c-968d-385934611c3a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:14.954559 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ddfcf418-0f7c-4f6c-968d-385934611c3a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:14.961219 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ddfcf418-0f7c-4f6c-968d-385934611c3a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:14.961664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ddfcf418-0f7c-4f6c-968d-385934611c3a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:14.962435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ddfcf418-0f7c-4f6c-968d-385934611c3a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:14.962866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ddfcf418-0f7c-4f6c-968d-385934611c3a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:15.088895 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ddfcf418-0f7c-4f6c-968d-385934611c3a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:15.096077 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ddfcf418-0f7c-4f6c-968d-385934611c3a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.145688 Jul 28 03:47:15.096620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 434/838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:14 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:16.020960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fa2151f7-071c-430b-829b-afc3add5a47b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:16.021566 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fa2151f7-071c-430b-829b-afc3add5a47b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:16.027143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa2151f7-071c-430b-829b-afc3add5a47b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:16.027587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa2151f7-071c-430b-829b-afc3add5a47b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:16.028385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa2151f7-071c-430b-829b-afc3add5a47b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:16.028816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa2151f7-071c-430b-829b-afc3add5a47b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:16.053079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fa2151f7-071c-430b-829b-afc3add5a47b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:47:16.133064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fa2151f7-071c-430b-829b-afc3add5a47b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "DELETE /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 204 len: 0 microversion: 2.20 time: 0.115678 Jul 28 03:47:16.133809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 435/839] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Jul 28 03:47:16 2021] DELETE /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 03:47:16.138704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-47834684-f22e-4953-b791-5df57e8702b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:16.139394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-47834684-f22e-4953-b791-5df57e8702b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:16.145495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47834684-f22e-4953-b791-5df57e8702b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:16.145937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47834684-f22e-4953-b791-5df57e8702b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:16.146697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47834684-f22e-4953-b791-5df57e8702b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:16.147129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47834684-f22e-4953-b791-5df57e8702b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:16.268229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-47834684-f22e-4953-b791-5df57e8702b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:16.276413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-47834684-f22e-4953-b791-5df57e8702b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.141524 Jul 28 03:47:16.276976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 436/840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:16 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:16.281266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-aa967ead-0f82-45a4-b67b-0940aea089e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:16.281855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-aa967ead-0f82-45a4-b67b-0940aea089e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:16.288359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa967ead-0f82-45a4-b67b-0940aea089e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:16.288809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa967ead-0f82-45a4-b67b-0940aea089e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:16.289572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa967ead-0f82-45a4-b67b-0940aea089e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:16.290003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa967ead-0f82-45a4-b67b-0940aea089e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:16.409786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-aa967ead-0f82-45a4-b67b-0940aea089e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:16.417967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-aa967ead-0f82-45a4-b67b-0940aea089e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:16.419455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-aa967ead-0f82-45a4-b67b-0940aea089e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:16.420601 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-aa967ead-0f82-45a4-b67b-0940aea089e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.142720 Jul 28 03:47:16.421158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 437/841] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:16 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:17.293987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b9663e38-6e6e-404a-b7e2-03dd3103b359 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:17.294596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b9663e38-6e6e-404a-b7e2-03dd3103b359 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:17.300397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b9663e38-6e6e-404a-b7e2-03dd3103b359 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:17.300845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b9663e38-6e6e-404a-b7e2-03dd3103b359 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:17.302255 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b9663e38-6e6e-404a-b7e2-03dd3103b359 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:17.302686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b9663e38-6e6e-404a-b7e2-03dd3103b359 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:17.422582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b9663e38-6e6e-404a-b7e2-03dd3103b359 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:17.430406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b9663e38-6e6e-404a-b7e2-03dd3103b359 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140048 Jul 28 03:47:17.430968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 438/842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:17 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:17.437782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-42bb5ea7-5f1c-435d-89fa-81f3c2b8a9f9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:17.438390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-42bb5ea7-5f1c-435d-89fa-81f3c2b8a9f9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:17.443886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42bb5ea7-5f1c-435d-89fa-81f3c2b8a9f9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:17.444337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42bb5ea7-5f1c-435d-89fa-81f3c2b8a9f9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:17.445108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42bb5ea7-5f1c-435d-89fa-81f3c2b8a9f9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:17.445547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42bb5ea7-5f1c-435d-89fa-81f3c2b8a9f9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:17.562298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-42bb5ea7-5f1c-435d-89fa-81f3c2b8a9f9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:17.570519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-42bb5ea7-5f1c-435d-89fa-81f3c2b8a9f9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:17.572031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-42bb5ea7-5f1c-435d-89fa-81f3c2b8a9f9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:17.573165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-42bb5ea7-5f1c-435d-89fa-81f3c2b8a9f9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.138861 Jul 28 03:47:17.573718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 439/843] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:17 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:18.448198 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9ba916eb-8879-45c9-bf45-2cc37e4bbec1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:18.448800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9ba916eb-8879-45c9-bf45-2cc37e4bbec1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:18.454531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ba916eb-8879-45c9-bf45-2cc37e4bbec1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:18.454987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ba916eb-8879-45c9-bf45-2cc37e4bbec1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:18.455776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ba916eb-8879-45c9-bf45-2cc37e4bbec1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:18.456219 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ba916eb-8879-45c9-bf45-2cc37e4bbec1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:18.574852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9ba916eb-8879-45c9-bf45-2cc37e4bbec1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:18.582125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9ba916eb-8879-45c9-bf45-2cc37e4bbec1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137628 Jul 28 03:47:18.582960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 440/844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:18 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:18.591088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a1284d18-53c2-437d-8c1f-845d69164bcf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:18.591689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a1284d18-53c2-437d-8c1f-845d69164bcf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:18.597143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a1284d18-53c2-437d-8c1f-845d69164bcf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:18.597586 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a1284d18-53c2-437d-8c1f-845d69164bcf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:18.599311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a1284d18-53c2-437d-8c1f-845d69164bcf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:18.599771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a1284d18-53c2-437d-8c1f-845d69164bcf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:18.720714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a1284d18-53c2-437d-8c1f-845d69164bcf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:18.729701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a1284d18-53c2-437d-8c1f-845d69164bcf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:18.731178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a1284d18-53c2-437d-8c1f-845d69164bcf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:18.732331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a1284d18-53c2-437d-8c1f-845d69164bcf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.144647 Jul 28 03:47:18.732872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 441/845] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:18 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:19.600268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e2b86a3c-e31a-4c8a-989f-a76b5277911b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:19.600919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e2b86a3c-e31a-4c8a-989f-a76b5277911b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:19.606610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2b86a3c-e31a-4c8a-989f-a76b5277911b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:19.607053 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2b86a3c-e31a-4c8a-989f-a76b5277911b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:19.607845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2b86a3c-e31a-4c8a-989f-a76b5277911b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:19.608274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2b86a3c-e31a-4c8a-989f-a76b5277911b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:19.727564 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e2b86a3c-e31a-4c8a-989f-a76b5277911b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:19.734788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e2b86a3c-e31a-4c8a-989f-a76b5277911b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139118 Jul 28 03:47:19.735344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 442/846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:19 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:19.749611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e3ce204f-bb2e-494c-a690-f15294f10484 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:19.750297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e3ce204f-bb2e-494c-a690-f15294f10484 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:19.756267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e3ce204f-bb2e-494c-a690-f15294f10484 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:19.756724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e3ce204f-bb2e-494c-a690-f15294f10484 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:19.757484 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e3ce204f-bb2e-494c-a690-f15294f10484 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:19.757918 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e3ce204f-bb2e-494c-a690-f15294f10484 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:19.877479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e3ce204f-bb2e-494c-a690-f15294f10484 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:19.885631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e3ce204f-bb2e-494c-a690-f15294f10484 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:19.887128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e3ce204f-bb2e-494c-a690-f15294f10484 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:19.888287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e3ce204f-bb2e-494c-a690-f15294f10484 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.142076 Jul 28 03:47:19.888835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 443/847] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:19 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:20.752331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-455af8b6-58eb-43c4-80b1-10f2dc2f8d2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:20.752923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-455af8b6-58eb-43c4-80b1-10f2dc2f8d2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:20.759285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-455af8b6-58eb-43c4-80b1-10f2dc2f8d2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:20.759753 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-455af8b6-58eb-43c4-80b1-10f2dc2f8d2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:20.760522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-455af8b6-58eb-43c4-80b1-10f2dc2f8d2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:20.760952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-455af8b6-58eb-43c4-80b1-10f2dc2f8d2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:20.884605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-455af8b6-58eb-43c4-80b1-10f2dc2f8d2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:20.891741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-455af8b6-58eb-43c4-80b1-10f2dc2f8d2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.143134 Jul 28 03:47:20.892291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 444/848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:20 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:20.905629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c2d8d235-7f77-486e-8612-5ef4e6f7ef17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:20.906227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c2d8d235-7f77-486e-8612-5ef4e6f7ef17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:20.912165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2d8d235-7f77-486e-8612-5ef4e6f7ef17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:20.912609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2d8d235-7f77-486e-8612-5ef4e6f7ef17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:20.913361 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2d8d235-7f77-486e-8612-5ef4e6f7ef17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:20.913787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2d8d235-7f77-486e-8612-5ef4e6f7ef17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:21.035107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c2d8d235-7f77-486e-8612-5ef4e6f7ef17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:21.043799 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c2d8d235-7f77-486e-8612-5ef4e6f7ef17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:21.045280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c2d8d235-7f77-486e-8612-5ef4e6f7ef17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:21.046406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c2d8d235-7f77-486e-8612-5ef4e6f7ef17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.144101 Jul 28 03:47:21.046989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 445/849] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:20 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:21.908353 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f16581e3-4a7b-4e52-ada9-d4b7993a66c2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:21.908962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f16581e3-4a7b-4e52-ada9-d4b7993a66c2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:21.914782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f16581e3-4a7b-4e52-ada9-d4b7993a66c2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:21.915230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f16581e3-4a7b-4e52-ada9-d4b7993a66c2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:21.916023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f16581e3-4a7b-4e52-ada9-d4b7993a66c2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:21.916460 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f16581e3-4a7b-4e52-ada9-d4b7993a66c2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:22.035195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f16581e3-4a7b-4e52-ada9-d4b7993a66c2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:22.042819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f16581e3-4a7b-4e52-ada9-d4b7993a66c2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138110 Jul 28 03:47:22.043374 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 446/850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:21 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:22.064838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9a57c124-d115-4717-bd79-a586f09e380f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:22.065443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9a57c124-d115-4717-bd79-a586f09e380f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:22.071985 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a57c124-d115-4717-bd79-a586f09e380f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:22.072430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a57c124-d115-4717-bd79-a586f09e380f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:22.073194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a57c124-d115-4717-bd79-a586f09e380f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:22.073621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a57c124-d115-4717-bd79-a586f09e380f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:22.198990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9a57c124-d115-4717-bd79-a586f09e380f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:22.207025 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9a57c124-d115-4717-bd79-a586f09e380f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:22.208969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9a57c124-d115-4717-bd79-a586f09e380f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:22.210094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9a57c124-d115-4717-bd79-a586f09e380f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.148571 Jul 28 03:47:22.210636 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 447/851] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:22 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:23.060268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-680a7bc6-484f-4d5d-8b6d-607e081d029f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:23.060869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-680a7bc6-484f-4d5d-8b6d-607e081d029f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:23.067202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-680a7bc6-484f-4d5d-8b6d-607e081d029f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:23.067788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-680a7bc6-484f-4d5d-8b6d-607e081d029f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:23.068567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-680a7bc6-484f-4d5d-8b6d-607e081d029f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:23.068997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-680a7bc6-484f-4d5d-8b6d-607e081d029f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:23.189597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-680a7bc6-484f-4d5d-8b6d-607e081d029f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:23.197630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-680a7bc6-484f-4d5d-8b6d-607e081d029f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.141029 Jul 28 03:47:23.198196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 448/852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:23 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:23.228295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b95d581c-f494-4c34-ab53-942b396005c1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:23.228905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b95d581c-f494-4c34-ab53-942b396005c1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:23.234635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b95d581c-f494-4c34-ab53-942b396005c1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:23.235087 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b95d581c-f494-4c34-ab53-942b396005c1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:23.235902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b95d581c-f494-4c34-ab53-942b396005c1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:23.236340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b95d581c-f494-4c34-ab53-942b396005c1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:23.357915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b95d581c-f494-4c34-ab53-942b396005c1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:23.366400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b95d581c-f494-4c34-ab53-942b396005c1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:23.367904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b95d581c-f494-4c34-ab53-942b396005c1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:23.369229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b95d581c-f494-4c34-ab53-942b396005c1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.144603 Jul 28 03:47:23.369946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 449/853] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:23 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:24.215984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b44fb84a-d1fb-4aa7-b2ac-91b9b0b444bc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:24.216589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b44fb84a-d1fb-4aa7-b2ac-91b9b0b444bc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:24.222223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b44fb84a-d1fb-4aa7-b2ac-91b9b0b444bc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:24.222671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b44fb84a-d1fb-4aa7-b2ac-91b9b0b444bc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:24.224085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b44fb84a-d1fb-4aa7-b2ac-91b9b0b444bc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:24.224512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b44fb84a-d1fb-4aa7-b2ac-91b9b0b444bc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:24.349020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b44fb84a-d1fb-4aa7-b2ac-91b9b0b444bc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:24.356244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b44fb84a-d1fb-4aa7-b2ac-91b9b0b444bc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.144206 Jul 28 03:47:24.356805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 450/854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:24 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:24.388143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-18ba544a-8164-42d4-a8b9-8fdb05dcf46b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:24.388691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-18ba544a-8164-42d4-a8b9-8fdb05dcf46b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:24.394332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18ba544a-8164-42d4-a8b9-8fdb05dcf46b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:24.395318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18ba544a-8164-42d4-a8b9-8fdb05dcf46b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:24.396263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18ba544a-8164-42d4-a8b9-8fdb05dcf46b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:24.396701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18ba544a-8164-42d4-a8b9-8fdb05dcf46b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:24.513596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-18ba544a-8164-42d4-a8b9-8fdb05dcf46b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:24.522279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-18ba544a-8164-42d4-a8b9-8fdb05dcf46b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:24.523800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-18ba544a-8164-42d4-a8b9-8fdb05dcf46b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:24.524936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-18ba544a-8164-42d4-a8b9-8fdb05dcf46b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.140300 Jul 28 03:47:24.525486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 451/855] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:24 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:25.373221 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4ec985ee-312c-454c-8505-9d0485bc3bb3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:25.373875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4ec985ee-312c-454c-8505-9d0485bc3bb3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:25.380269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ec985ee-312c-454c-8505-9d0485bc3bb3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:25.380708 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ec985ee-312c-454c-8505-9d0485bc3bb3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:25.381465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ec985ee-312c-454c-8505-9d0485bc3bb3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:25.381894 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ec985ee-312c-454c-8505-9d0485bc3bb3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:25.500536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4ec985ee-312c-454c-8505-9d0485bc3bb3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:25.508406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4ec985ee-312c-454c-8505-9d0485bc3bb3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138811 Jul 28 03:47:25.508962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 452/856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:25 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:25.543382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c9155e31-f8b3-4373-8fc9-6059366b5f7f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:25.544041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c9155e31-f8b3-4373-8fc9-6059366b5f7f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:25.549663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9155e31-f8b3-4373-8fc9-6059366b5f7f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:25.550113 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9155e31-f8b3-4373-8fc9-6059366b5f7f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:25.550879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9155e31-f8b3-4373-8fc9-6059366b5f7f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:25.551413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9155e31-f8b3-4373-8fc9-6059366b5f7f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:25.675933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c9155e31-f8b3-4373-8fc9-6059366b5f7f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:25.684238 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c9155e31-f8b3-4373-8fc9-6059366b5f7f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:25.685735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c9155e31-f8b3-4373-8fc9-6059366b5f7f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:25.686867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c9155e31-f8b3-4373-8fc9-6059366b5f7f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.147068 Jul 28 03:47:25.687416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 453/857] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:25 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:26.525439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cfde4e61-bd92-43b0-8e6e-4402d82d41ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:26.526074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cfde4e61-bd92-43b0-8e6e-4402d82d41ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:26.531856 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfde4e61-bd92-43b0-8e6e-4402d82d41ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:26.532298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfde4e61-bd92-43b0-8e6e-4402d82d41ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:26.533052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfde4e61-bd92-43b0-8e6e-4402d82d41ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:26.533483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfde4e61-bd92-43b0-8e6e-4402d82d41ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:26.652040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cfde4e61-bd92-43b0-8e6e-4402d82d41ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:26.659322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cfde4e61-bd92-43b0-8e6e-4402d82d41ed tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137531 Jul 28 03:47:26.659937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 454/858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:26 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:26.709186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dbb99825-0ab8-4eed-b705-8d7b2dae82b9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:26.709802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dbb99825-0ab8-4eed-b705-8d7b2dae82b9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:26.715537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbb99825-0ab8-4eed-b705-8d7b2dae82b9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:26.716026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbb99825-0ab8-4eed-b705-8d7b2dae82b9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:26.716795 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbb99825-0ab8-4eed-b705-8d7b2dae82b9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:26.717232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbb99825-0ab8-4eed-b705-8d7b2dae82b9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:26.836206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dbb99825-0ab8-4eed-b705-8d7b2dae82b9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:26.844231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dbb99825-0ab8-4eed-b705-8d7b2dae82b9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:26.845722 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dbb99825-0ab8-4eed-b705-8d7b2dae82b9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:26.846849 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dbb99825-0ab8-4eed-b705-8d7b2dae82b9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.142024 Jul 28 03:47:26.847410 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 455/859] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:26 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:27.677698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d5dcb3b6-9d4a-445d-9d71-1e67136d5e67 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:27.678341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d5dcb3b6-9d4a-445d-9d71-1e67136d5e67 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:27.684126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5dcb3b6-9d4a-445d-9d71-1e67136d5e67 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:27.684575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5dcb3b6-9d4a-445d-9d71-1e67136d5e67 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:27.685341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5dcb3b6-9d4a-445d-9d71-1e67136d5e67 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:27.685777 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5dcb3b6-9d4a-445d-9d71-1e67136d5e67 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:27.810699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d5dcb3b6-9d4a-445d-9d71-1e67136d5e67 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:27.818372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d5dcb3b6-9d4a-445d-9d71-1e67136d5e67 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.144953 Jul 28 03:47:27.818926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 456/860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:27 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:27.865973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dd26fc3a-57de-41aa-b628-6b3b987918ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:27.866591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dd26fc3a-57de-41aa-b628-6b3b987918ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:27.872419 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd26fc3a-57de-41aa-b628-6b3b987918ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:27.872868 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd26fc3a-57de-41aa-b628-6b3b987918ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:27.873645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd26fc3a-57de-41aa-b628-6b3b987918ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:27.874079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dd26fc3a-57de-41aa-b628-6b3b987918ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:27.998058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dd26fc3a-57de-41aa-b628-6b3b987918ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:28.007119 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dd26fc3a-57de-41aa-b628-6b3b987918ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:28.008738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dd26fc3a-57de-41aa-b628-6b3b987918ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:28.009871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dd26fc3a-57de-41aa-b628-6b3b987918ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.148321 Jul 28 03:47:28.010403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 457/861] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:27 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:28.835154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5a5b9f6c-94f6-40e8-b55f-3639e14422ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:28.835836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5a5b9f6c-94f6-40e8-b55f-3639e14422ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:28.841660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a5b9f6c-94f6-40e8-b55f-3639e14422ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:28.842135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a5b9f6c-94f6-40e8-b55f-3639e14422ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:28.842894 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a5b9f6c-94f6-40e8-b55f-3639e14422ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:28.843323 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a5b9f6c-94f6-40e8-b55f-3639e14422ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:28.961612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5a5b9f6c-94f6-40e8-b55f-3639e14422ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:28.969313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5a5b9f6c-94f6-40e8-b55f-3639e14422ec tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137755 Jul 28 03:47:28.969875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 458/862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:28 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:29.027943 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-21345992-20bc-4d02-b8c9-14a60db13277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:29.028631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-21345992-20bc-4d02-b8c9-14a60db13277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:29.034875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-21345992-20bc-4d02-b8c9-14a60db13277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:29.035495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-21345992-20bc-4d02-b8c9-14a60db13277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:29.036305 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-21345992-20bc-4d02-b8c9-14a60db13277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:29.036741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-21345992-20bc-4d02-b8c9-14a60db13277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:29.165877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-21345992-20bc-4d02-b8c9-14a60db13277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:29.174089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-21345992-20bc-4d02-b8c9-14a60db13277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:29.175573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-21345992-20bc-4d02-b8c9-14a60db13277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:29.177347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-21345992-20bc-4d02-b8c9-14a60db13277 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.153191 Jul 28 03:47:29.177891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 459/863] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:29 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:29.987677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-42f813d3-1605-4bc6-ba7f-84eb8c2fa8b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:29.988315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-42f813d3-1605-4bc6-ba7f-84eb8c2fa8b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:29.994147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42f813d3-1605-4bc6-ba7f-84eb8c2fa8b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:29.994597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42f813d3-1605-4bc6-ba7f-84eb8c2fa8b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:29.995360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42f813d3-1605-4bc6-ba7f-84eb8c2fa8b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:29.995829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42f813d3-1605-4bc6-ba7f-84eb8c2fa8b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:30.266569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-42f813d3-1605-4bc6-ba7f-84eb8c2fa8b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:30.274117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-42f813d3-1605-4bc6-ba7f-84eb8c2fa8b7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.290206 Jul 28 03:47:30.274670 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 460/864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:29 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:30.408727 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1e301463-00d9-4710-a172-0a9d89afe4e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:30.409343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1e301463-00d9-4710-a172-0a9d89afe4e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:30.415375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e301463-00d9-4710-a172-0a9d89afe4e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:30.415872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e301463-00d9-4710-a172-0a9d89afe4e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:30.416631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e301463-00d9-4710-a172-0a9d89afe4e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:30.417059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e301463-00d9-4710-a172-0a9d89afe4e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:30.535377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1e301463-00d9-4710-a172-0a9d89afe4e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:30.543622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1e301463-00d9-4710-a172-0a9d89afe4e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:30.545133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1e301463-00d9-4710-a172-0a9d89afe4e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:30.546262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1e301463-00d9-4710-a172-0a9d89afe4e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.270679 Jul 28 03:47:30.546815 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 461/865] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:30 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:31.291455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5482ad27-7ceb-41bc-bccb-ff3b7ae99557 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:31.292151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5482ad27-7ceb-41bc-bccb-ff3b7ae99557 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:31.297771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5482ad27-7ceb-41bc-bccb-ff3b7ae99557 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:31.298213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5482ad27-7ceb-41bc-bccb-ff3b7ae99557 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:31.299065 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5482ad27-7ceb-41bc-bccb-ff3b7ae99557 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:31.299495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5482ad27-7ceb-41bc-bccb-ff3b7ae99557 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:31.426103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5482ad27-7ceb-41bc-bccb-ff3b7ae99557 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:31.433304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5482ad27-7ceb-41bc-bccb-ff3b7ae99557 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.145646 Jul 28 03:47:31.433854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 462/866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:31 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:31.564437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a67f6478-6023-46d0-930f-a05b18767727 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:31.565036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a67f6478-6023-46d0-930f-a05b18767727 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:31.570672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a67f6478-6023-46d0-930f-a05b18767727 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:31.571121 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a67f6478-6023-46d0-930f-a05b18767727 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:31.571909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a67f6478-6023-46d0-930f-a05b18767727 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:31.572341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a67f6478-6023-46d0-930f-a05b18767727 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:31.691324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a67f6478-6023-46d0-930f-a05b18767727 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:31.700340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a67f6478-6023-46d0-930f-a05b18767727 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:31.701839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a67f6478-6023-46d0-930f-a05b18767727 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:31.702971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a67f6478-6023-46d0-930f-a05b18767727 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.142004 Jul 28 03:47:31.703658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 463/867] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:31 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:32.450127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ab0ae4ed-09a1-4547-89ab-a6685331715c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:32.450713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ab0ae4ed-09a1-4547-89ab-a6685331715c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:32.456591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab0ae4ed-09a1-4547-89ab-a6685331715c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:32.457769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab0ae4ed-09a1-4547-89ab-a6685331715c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:32.458695 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab0ae4ed-09a1-4547-89ab-a6685331715c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:32.459280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab0ae4ed-09a1-4547-89ab-a6685331715c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:32.700195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ab0ae4ed-09a1-4547-89ab-a6685331715c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:32.708101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ab0ae4ed-09a1-4547-89ab-a6685331715c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.260803 Jul 28 03:47:32.708677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 464/868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:32 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:32.721309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e36ad859-6416-4737-a419-25b4d6cb02ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:32.721914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e36ad859-6416-4737-a419-25b4d6cb02ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:32.728417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e36ad859-6416-4737-a419-25b4d6cb02ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:32.728860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e36ad859-6416-4737-a419-25b4d6cb02ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:32.729628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e36ad859-6416-4737-a419-25b4d6cb02ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:32.730060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e36ad859-6416-4737-a419-25b4d6cb02ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:32.945949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e36ad859-6416-4737-a419-25b4d6cb02ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:32.954190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e36ad859-6416-4737-a419-25b4d6cb02ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:32.955658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e36ad859-6416-4737-a419-25b4d6cb02ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:32.956806 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e36ad859-6416-4737-a419-25b4d6cb02ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1798 microversion: 2.20 time: 0.239112 Jul 28 03:47:32.957883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 465/869] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:32 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1798 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:33.395289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-a386ad90-db5f-48d4-828a-4c17a5fc4f0f req-13b73152-8f5f-4d0e-97de-f90d7466a4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622af242-a6fc-4f2d-9f03-61e88ee5e89f", "name": "network-vif-deleted", "tag": "f743ec9f-b513-4bb3-b819-5c932959e75f"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:33.396336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:47:33.396336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:47:33.403503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-a386ad90-db5f-48d4-828a-4c17a5fc4f0f req-13b73152-8f5f-4d0e-97de-f90d7466a4c1 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:33.403921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-a386ad90-db5f-48d4-828a-4c17a5fc4f0f req-13b73152-8f5f-4d0e-97de-f90d7466a4c1 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:33.415075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-a386ad90-db5f-48d4-828a-4c17a5fc4f0f req-13b73152-8f5f-4d0e-97de-f90d7466a4c1 service nova] Creating event network-vif-deleted:f743ec9f-b513-4bb3-b819-5c932959e75f for instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f on hv-cinder-73306 Jul 28 03:47:33.427796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-a386ad90-db5f-48d4-828a-4c17a5fc4f0f req-13b73152-8f5f-4d0e-97de-f90d7466a4c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090881 Jul 28 03:47:33.428660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 466/870] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:47:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:47:33.726483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3d3345af-5458-4f8d-9e53-2666daccad8e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.727247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3d3345af-5458-4f8d-9e53-2666daccad8e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:33.733491 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d3345af-5458-4f8d-9e53-2666daccad8e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:33.733950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d3345af-5458-4f8d-9e53-2666daccad8e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:33.734740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d3345af-5458-4f8d-9e53-2666daccad8e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:33.735188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d3345af-5458-4f8d-9e53-2666daccad8e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:33.859237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3d3345af-5458-4f8d-9e53-2666daccad8e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:33.879860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3d3345af-5458-4f8d-9e53-2666daccad8e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.157862 Jul 28 03:47:33.880469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 467/871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:33 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:33.975991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7fb32db7-5338-44f1-ab9f-4dbe45254506 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.976599 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7fb32db7-5338-44f1-ab9f-4dbe45254506 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:33.982364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7fb32db7-5338-44f1-ab9f-4dbe45254506 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:33.982811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7fb32db7-5338-44f1-ab9f-4dbe45254506 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:33.983586 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7fb32db7-5338-44f1-ab9f-4dbe45254506 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:33.984094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7fb32db7-5338-44f1-ab9f-4dbe45254506 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:34.049285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7fb32db7-5338-44f1-ab9f-4dbe45254506 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:34.058532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7fb32db7-5338-44f1-ab9f-4dbe45254506 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:34.060178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7fb32db7-5338-44f1-ab9f-4dbe45254506 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:34.061420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7fb32db7-5338-44f1-ab9f-4dbe45254506 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.090135 Jul 28 03:47:34.062180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 468/872] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:33 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:34.897523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ae0956f6-2337-4416-972f-5c92163cecab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:34.898222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ae0956f6-2337-4416-972f-5c92163cecab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:34.904137 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae0956f6-2337-4416-972f-5c92163cecab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:34.904581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae0956f6-2337-4416-972f-5c92163cecab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:34.905353 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae0956f6-2337-4416-972f-5c92163cecab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:34.905784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae0956f6-2337-4416-972f-5c92163cecab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:35.027611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ae0956f6-2337-4416-972f-5c92163cecab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:35.034967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ae0956f6-2337-4416-972f-5c92163cecab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.141659 Jul 28 03:47:35.035908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 469/873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:34 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:35.078896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0fb79143-84cf-4dc7-a20b-27551ea8398c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:35.079499 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0fb79143-84cf-4dc7-a20b-27551ea8398c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:35.085149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fb79143-84cf-4dc7-a20b-27551ea8398c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:35.085597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fb79143-84cf-4dc7-a20b-27551ea8398c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:35.086360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fb79143-84cf-4dc7-a20b-27551ea8398c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:35.086791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fb79143-84cf-4dc7-a20b-27551ea8398c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:35.146697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0fb79143-84cf-4dc7-a20b-27551ea8398c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:35.155519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0fb79143-84cf-4dc7-a20b-27551ea8398c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:35.156962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0fb79143-84cf-4dc7-a20b-27551ea8398c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:35.158067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0fb79143-84cf-4dc7-a20b-27551ea8398c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082580 Jul 28 03:47:35.158609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 470/874] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:35 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:47:36.052882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7c0ff5ee-0a21-4946-95a3-400d932873c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:36.053486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7c0ff5ee-0a21-4946-95a3-400d932873c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:36.059283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c0ff5ee-0a21-4946-95a3-400d932873c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:36.059754 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c0ff5ee-0a21-4946-95a3-400d932873c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:36.060525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c0ff5ee-0a21-4946-95a3-400d932873c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:36.060963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c0ff5ee-0a21-4946-95a3-400d932873c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:36.186166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7c0ff5ee-0a21-4946-95a3-400d932873c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:36.193807 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7c0ff5ee-0a21-4946-95a3-400d932873c1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.145132 Jul 28 03:47:36.194366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 471/875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:36 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:36.198684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-89c0b76b-d9f9-40e7-aa34-38fbcf31d6bd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:36.199282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-89c0b76b-d9f9-40e7-aa34-38fbcf31d6bd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:36.204516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89c0b76b-d9f9-40e7-aa34-38fbcf31d6bd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:36.204967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89c0b76b-d9f9-40e7-aa34-38fbcf31d6bd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:36.205728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89c0b76b-d9f9-40e7-aa34-38fbcf31d6bd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:36.206157 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89c0b76b-d9f9-40e7-aa34-38fbcf31d6bd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:36.265437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-89c0b76b-d9f9-40e7-aa34-38fbcf31d6bd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:36.274027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-89c0b76b-d9f9-40e7-aa34-38fbcf31d6bd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:36.275510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-89c0b76b-d9f9-40e7-aa34-38fbcf31d6bd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:36.276634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-89c0b76b-d9f9-40e7-aa34-38fbcf31d6bd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081290 Jul 28 03:47:36.277178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 472/876] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:36 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:37.210190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f4a05053-a971-48d2-b3c0-99c8671bdb02 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:37.210827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f4a05053-a971-48d2-b3c0-99c8671bdb02 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:37.216591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4a05053-a971-48d2-b3c0-99c8671bdb02 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:37.217030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4a05053-a971-48d2-b3c0-99c8671bdb02 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:37.217783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4a05053-a971-48d2-b3c0-99c8671bdb02 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:37.218210 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4a05053-a971-48d2-b3c0-99c8671bdb02 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:37.340105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f4a05053-a971-48d2-b3c0-99c8671bdb02 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:37.347287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f4a05053-a971-48d2-b3c0-99c8671bdb02 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140848 Jul 28 03:47:37.348769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 473/877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:37 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:37.352932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fe49159a-fea7-45e7-9309-211712c2adb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:37.353530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fe49159a-fea7-45e7-9309-211712c2adb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:37.358721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe49159a-fea7-45e7-9309-211712c2adb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:37.359157 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe49159a-fea7-45e7-9309-211712c2adb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:37.359936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe49159a-fea7-45e7-9309-211712c2adb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:37.360363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe49159a-fea7-45e7-9309-211712c2adb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:37.419142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fe49159a-fea7-45e7-9309-211712c2adb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:37.427992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fe49159a-fea7-45e7-9309-211712c2adb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:37.429461 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fe49159a-fea7-45e7-9309-211712c2adb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:37.430551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fe49159a-fea7-45e7-9309-211712c2adb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080945 Jul 28 03:47:37.431090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 474/878] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:37 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:38.365028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dc378462-5bcd-40bd-b37d-090cc62f7392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:38.366386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dc378462-5bcd-40bd-b37d-090cc62f7392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:38.372200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dc378462-5bcd-40bd-b37d-090cc62f7392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:38.372643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dc378462-5bcd-40bd-b37d-090cc62f7392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:38.373398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dc378462-5bcd-40bd-b37d-090cc62f7392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:38.373822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dc378462-5bcd-40bd-b37d-090cc62f7392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:38.495020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dc378462-5bcd-40bd-b37d-090cc62f7392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:38.502256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dc378462-5bcd-40bd-b37d-090cc62f7392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140908 Jul 28 03:47:38.502812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 475/879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:38 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:38.507007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-43ebfc51-8ccc-4259-b27f-2309edf04ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:38.507606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-43ebfc51-8ccc-4259-b27f-2309edf04ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:38.512897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-43ebfc51-8ccc-4259-b27f-2309edf04ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:38.513344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-43ebfc51-8ccc-4259-b27f-2309edf04ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:38.514107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-43ebfc51-8ccc-4259-b27f-2309edf04ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:38.514541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-43ebfc51-8ccc-4259-b27f-2309edf04ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:38.573191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-43ebfc51-8ccc-4259-b27f-2309edf04ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:38.581211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-43ebfc51-8ccc-4259-b27f-2309edf04ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:38.582692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-43ebfc51-8ccc-4259-b27f-2309edf04ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:38.584493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-43ebfc51-8ccc-4259-b27f-2309edf04ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080756 Jul 28 03:47:38.585039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 476/880] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:38 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:39.519325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fe781a3b-6a16-42e2-b56e-8e776a9140f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:39.519959 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fe781a3b-6a16-42e2-b56e-8e776a9140f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:39.525732 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe781a3b-6a16-42e2-b56e-8e776a9140f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:39.526187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe781a3b-6a16-42e2-b56e-8e776a9140f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:39.526963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe781a3b-6a16-42e2-b56e-8e776a9140f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:39.527404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe781a3b-6a16-42e2-b56e-8e776a9140f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:39.644740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fe781a3b-6a16-42e2-b56e-8e776a9140f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:39.652355 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fe781a3b-6a16-42e2-b56e-8e776a9140f1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.136825 Jul 28 03:47:39.652911 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 477/881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:39 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:39.657191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-edb58b23-311a-4770-8527-7ca6487914c3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:39.657788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-edb58b23-311a-4770-8527-7ca6487914c3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:39.663756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-edb58b23-311a-4770-8527-7ca6487914c3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:39.664207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-edb58b23-311a-4770-8527-7ca6487914c3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:39.664969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-edb58b23-311a-4770-8527-7ca6487914c3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:39.665406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-edb58b23-311a-4770-8527-7ca6487914c3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:39.727267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-edb58b23-311a-4770-8527-7ca6487914c3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:39.735329 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-edb58b23-311a-4770-8527-7ca6487914c3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:39.736850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-edb58b23-311a-4770-8527-7ca6487914c3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:39.737950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-edb58b23-311a-4770-8527-7ca6487914c3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084131 Jul 28 03:47:39.738495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 478/882] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:39 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:40.669728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d6fc4882-8187-4af0-b5ec-d33be2266c75 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:40.670350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d6fc4882-8187-4af0-b5ec-d33be2266c75 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:40.676131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d6fc4882-8187-4af0-b5ec-d33be2266c75 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:40.677191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d6fc4882-8187-4af0-b5ec-d33be2266c75 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:40.678065 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d6fc4882-8187-4af0-b5ec-d33be2266c75 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:40.678502 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d6fc4882-8187-4af0-b5ec-d33be2266c75 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:40.797152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d6fc4882-8187-4af0-b5ec-d33be2266c75 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:40.804556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d6fc4882-8187-4af0-b5ec-d33be2266c75 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138455 Jul 28 03:47:40.805126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 479/883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:40 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:40.809280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c5d70700-32be-433c-89b8-d38397ddb9f3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:40.809878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c5d70700-32be-433c-89b8-d38397ddb9f3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:40.815220 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5d70700-32be-433c-89b8-d38397ddb9f3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:40.815666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5d70700-32be-433c-89b8-d38397ddb9f3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:40.816456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5d70700-32be-433c-89b8-d38397ddb9f3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:40.816931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5d70700-32be-433c-89b8-d38397ddb9f3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:40.876546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c5d70700-32be-433c-89b8-d38397ddb9f3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:40.884529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c5d70700-32be-433c-89b8-d38397ddb9f3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:40.886003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c5d70700-32be-433c-89b8-d38397ddb9f3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:40.887101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c5d70700-32be-433c-89b8-d38397ddb9f3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081067 Jul 28 03:47:40.887648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 480/884] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:40 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:41.821742 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-952c1a5d-3bdc-4d27-9d7e-9f6561a4ec72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:41.822412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-952c1a5d-3bdc-4d27-9d7e-9f6561a4ec72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:41.828182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-952c1a5d-3bdc-4d27-9d7e-9f6561a4ec72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:41.828631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-952c1a5d-3bdc-4d27-9d7e-9f6561a4ec72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:41.829458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-952c1a5d-3bdc-4d27-9d7e-9f6561a4ec72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:41.829893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-952c1a5d-3bdc-4d27-9d7e-9f6561a4ec72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:41.947299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-952c1a5d-3bdc-4d27-9d7e-9f6561a4ec72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:41.954542 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-952c1a5d-3bdc-4d27-9d7e-9f6561a4ec72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137187 Jul 28 03:47:41.955104 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 481/885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:41 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:41.959325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-562f347a-580a-498b-8b2a-d295ac669a7c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:41.959949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-562f347a-580a-498b-8b2a-d295ac669a7c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:41.965174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-562f347a-580a-498b-8b2a-d295ac669a7c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:41.965624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-562f347a-580a-498b-8b2a-d295ac669a7c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:41.966392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-562f347a-580a-498b-8b2a-d295ac669a7c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:41.966829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-562f347a-580a-498b-8b2a-d295ac669a7c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:42.028684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-562f347a-580a-498b-8b2a-d295ac669a7c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:42.037315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-562f347a-580a-498b-8b2a-d295ac669a7c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:42.038805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-562f347a-580a-498b-8b2a-d295ac669a7c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:42.039956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-562f347a-580a-498b-8b2a-d295ac669a7c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.083896 Jul 28 03:47:42.040510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 482/886] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:41 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:42.972085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-424a9173-0b75-4201-af3b-0706c1dec1d0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:42.972732 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-424a9173-0b75-4201-af3b-0706c1dec1d0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:42.978856 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-424a9173-0b75-4201-af3b-0706c1dec1d0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:42.979298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-424a9173-0b75-4201-af3b-0706c1dec1d0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:42.980084 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-424a9173-0b75-4201-af3b-0706c1dec1d0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:42.980512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-424a9173-0b75-4201-af3b-0706c1dec1d0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:43.098651 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-424a9173-0b75-4201-af3b-0706c1dec1d0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:43.106437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-424a9173-0b75-4201-af3b-0706c1dec1d0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138004 Jul 28 03:47:43.106994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 483/887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:42 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:43.111137 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8d9bbe41-8759-46a8-a647-e779c659da3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:43.111752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8d9bbe41-8759-46a8-a647-e779c659da3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:43.117721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d9bbe41-8759-46a8-a647-e779c659da3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:43.118173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d9bbe41-8759-46a8-a647-e779c659da3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:43.119041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d9bbe41-8759-46a8-a647-e779c659da3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:43.119483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d9bbe41-8759-46a8-a647-e779c659da3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:43.180522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d9bbe41-8759-46a8-a647-e779c659da3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:43.188684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d9bbe41-8759-46a8-a647-e779c659da3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:43.190171 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d9bbe41-8759-46a8-a647-e779c659da3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:43.191278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8d9bbe41-8759-46a8-a647-e779c659da3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.083380 Jul 28 03:47:43.191867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 484/888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:43 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:44.124082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-94bb7d50-e0a5-4af2-978c-e9fb778ec815 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:44.124719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-94bb7d50-e0a5-4af2-978c-e9fb778ec815 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:44.130994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-94bb7d50-e0a5-4af2-978c-e9fb778ec815 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:44.131436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-94bb7d50-e0a5-4af2-978c-e9fb778ec815 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:44.132232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-94bb7d50-e0a5-4af2-978c-e9fb778ec815 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:44.132667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-94bb7d50-e0a5-4af2-978c-e9fb778ec815 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:44.252914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-94bb7d50-e0a5-4af2-978c-e9fb778ec815 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:44.261303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-94bb7d50-e0a5-4af2-978c-e9fb778ec815 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140977 Jul 28 03:47:44.261898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 485/889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:44 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:44.266142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-809ac234-9629-487a-9833-216f6aa77068 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:44.266737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-809ac234-9629-487a-9833-216f6aa77068 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:44.272681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-809ac234-9629-487a-9833-216f6aa77068 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:44.273124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-809ac234-9629-487a-9833-216f6aa77068 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:44.273883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-809ac234-9629-487a-9833-216f6aa77068 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:44.274307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-809ac234-9629-487a-9833-216f6aa77068 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:44.332005 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-809ac234-9629-487a-9833-216f6aa77068 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:44.340679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-809ac234-9629-487a-9833-216f6aa77068 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:44.342157 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-809ac234-9629-487a-9833-216f6aa77068 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:44.343245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-809ac234-9629-487a-9833-216f6aa77068 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080450 Jul 28 03:47:44.343817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 486/890] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:44 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:45.278980 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-380a38a8-4f86-4830-9592-8431183fa4a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:45.279601 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-380a38a8-4f86-4830-9592-8431183fa4a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:45.285360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-380a38a8-4f86-4830-9592-8431183fa4a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:45.286774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-380a38a8-4f86-4830-9592-8431183fa4a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:45.287558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-380a38a8-4f86-4830-9592-8431183fa4a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:45.288029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-380a38a8-4f86-4830-9592-8431183fa4a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:45.408761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-380a38a8-4f86-4830-9592-8431183fa4a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:45.417080 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-380a38a8-4f86-4830-9592-8431183fa4a8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.141731 Jul 28 03:47:45.417632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 487/891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:45 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:45.421796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8efa8e98-2172-4de5-9e7b-765caeeb0150 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:45.422387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8efa8e98-2172-4de5-9e7b-765caeeb0150 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:45.428072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8efa8e98-2172-4de5-9e7b-765caeeb0150 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:45.428512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8efa8e98-2172-4de5-9e7b-765caeeb0150 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:45.429266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8efa8e98-2172-4de5-9e7b-765caeeb0150 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:45.429697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8efa8e98-2172-4de5-9e7b-765caeeb0150 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:45.488039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8efa8e98-2172-4de5-9e7b-765caeeb0150 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:45.496226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8efa8e98-2172-4de5-9e7b-765caeeb0150 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:45.497724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8efa8e98-2172-4de5-9e7b-765caeeb0150 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:45.498833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8efa8e98-2172-4de5-9e7b-765caeeb0150 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080290 Jul 28 03:47:45.499388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 488/892] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:45 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:46.433406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3243d136-5d3a-4159-b5ce-ef56db79e474 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:46.434113 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3243d136-5d3a-4159-b5ce-ef56db79e474 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:46.439635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3243d136-5d3a-4159-b5ce-ef56db79e474 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:46.440111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3243d136-5d3a-4159-b5ce-ef56db79e474 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:46.440861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3243d136-5d3a-4159-b5ce-ef56db79e474 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:46.441291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3243d136-5d3a-4159-b5ce-ef56db79e474 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:46.560819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3243d136-5d3a-4159-b5ce-ef56db79e474 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:46.568126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3243d136-5d3a-4159-b5ce-ef56db79e474 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138355 Jul 28 03:47:46.568682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 489/893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:46 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:46.572872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d8c7e4ce-dd41-4ad8-9ec7-956f4a5e008d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:46.573476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d8c7e4ce-dd41-4ad8-9ec7-956f4a5e008d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:46.578728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d8c7e4ce-dd41-4ad8-9ec7-956f4a5e008d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:46.579174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d8c7e4ce-dd41-4ad8-9ec7-956f4a5e008d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:46.579962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d8c7e4ce-dd41-4ad8-9ec7-956f4a5e008d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:46.580400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d8c7e4ce-dd41-4ad8-9ec7-956f4a5e008d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:46.638915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d8c7e4ce-dd41-4ad8-9ec7-956f4a5e008d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:46.647043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d8c7e4ce-dd41-4ad8-9ec7-956f4a5e008d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:46.648573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d8c7e4ce-dd41-4ad8-9ec7-956f4a5e008d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:46.649681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d8c7e4ce-dd41-4ad8-9ec7-956f4a5e008d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080079 Jul 28 03:47:46.650228 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 490/894] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:46 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:47.586558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e0c61eb7-cf54-49a8-8b13-7f0a5acdc856 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:47.587198 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e0c61eb7-cf54-49a8-8b13-7f0a5acdc856 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:47.592844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0c61eb7-cf54-49a8-8b13-7f0a5acdc856 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:47.593288 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0c61eb7-cf54-49a8-8b13-7f0a5acdc856 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:47.594046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0c61eb7-cf54-49a8-8b13-7f0a5acdc856 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:47.594472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0c61eb7-cf54-49a8-8b13-7f0a5acdc856 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:47.712398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e0c61eb7-cf54-49a8-8b13-7f0a5acdc856 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:47.719496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e0c61eb7-cf54-49a8-8b13-7f0a5acdc856 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137592 Jul 28 03:47:47.720083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 491/895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:47 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:47.725313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e7efad26-0ad7-43f2-9135-46d0f8aa727e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:47.725908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e7efad26-0ad7-43f2-9135-46d0f8aa727e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:47.731086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7efad26-0ad7-43f2-9135-46d0f8aa727e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:47.731526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7efad26-0ad7-43f2-9135-46d0f8aa727e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:47.732320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7efad26-0ad7-43f2-9135-46d0f8aa727e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:47.732752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7efad26-0ad7-43f2-9135-46d0f8aa727e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:47.795843 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e7efad26-0ad7-43f2-9135-46d0f8aa727e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:47.804048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e7efad26-0ad7-43f2-9135-46d0f8aa727e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:47.805531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e7efad26-0ad7-43f2-9135-46d0f8aa727e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:47.806663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e7efad26-0ad7-43f2-9135-46d0f8aa727e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.085647 Jul 28 03:47:47.807209 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 492/896] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:47 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:48.736079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e32a04e3-31fa-4b05-9842-84539a54769f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:48.736741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e32a04e3-31fa-4b05-9842-84539a54769f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:48.743125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e32a04e3-31fa-4b05-9842-84539a54769f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:48.743571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e32a04e3-31fa-4b05-9842-84539a54769f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:48.744369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e32a04e3-31fa-4b05-9842-84539a54769f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:48.744801 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e32a04e3-31fa-4b05-9842-84539a54769f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:48.862768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e32a04e3-31fa-4b05-9842-84539a54769f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:48.870085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e32a04e3-31fa-4b05-9842-84539a54769f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137670 Jul 28 03:47:48.870635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 493/897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:48 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:48.874790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1776c8b1-59c5-4caa-8a65-4c86cd6c885e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:48.875389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1776c8b1-59c5-4caa-8a65-4c86cd6c885e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:48.881386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1776c8b1-59c5-4caa-8a65-4c86cd6c885e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:48.881865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1776c8b1-59c5-4caa-8a65-4c86cd6c885e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:48.882637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1776c8b1-59c5-4caa-8a65-4c86cd6c885e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:48.883069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1776c8b1-59c5-4caa-8a65-4c86cd6c885e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:48.941652 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1776c8b1-59c5-4caa-8a65-4c86cd6c885e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:48.955835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1776c8b1-59c5-4caa-8a65-4c86cd6c885e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:48.959031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1776c8b1-59c5-4caa-8a65-4c86cd6c885e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:48.960241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1776c8b1-59c5-4caa-8a65-4c86cd6c885e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.088639 Jul 28 03:47:48.960794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 494/898] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:48 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:49.887115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8d440318-a165-4ccf-a4dc-604ea9025b69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:49.887749 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8d440318-a165-4ccf-a4dc-604ea9025b69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:49.893568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d440318-a165-4ccf-a4dc-604ea9025b69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:49.894016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d440318-a165-4ccf-a4dc-604ea9025b69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:49.894780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d440318-a165-4ccf-a4dc-604ea9025b69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:49.895396 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d440318-a165-4ccf-a4dc-604ea9025b69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:50.012183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d440318-a165-4ccf-a4dc-604ea9025b69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:50.019538 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8d440318-a165-4ccf-a4dc-604ea9025b69 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.136097 Jul 28 03:47:50.020120 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 495/899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:49 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:50.024280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a4c96cfc-76d0-4408-abf4-3cad706f3969 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:50.024872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a4c96cfc-76d0-4408-abf4-3cad706f3969 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:50.030285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4c96cfc-76d0-4408-abf4-3cad706f3969 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:50.030724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4c96cfc-76d0-4408-abf4-3cad706f3969 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:50.031480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4c96cfc-76d0-4408-abf4-3cad706f3969 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:50.031932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4c96cfc-76d0-4408-abf4-3cad706f3969 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:50.092659 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4c96cfc-76d0-4408-abf4-3cad706f3969 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:50.101493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4c96cfc-76d0-4408-abf4-3cad706f3969 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:50.102972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4c96cfc-76d0-4408-abf4-3cad706f3969 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:50.104143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a4c96cfc-76d0-4408-abf4-3cad706f3969 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.083049 Jul 28 03:47:50.104687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 496/900] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:50 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:51.036832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-37f44d93-531c-4700-83d9-4e8827e43970 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:51.037486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-37f44d93-531c-4700-83d9-4e8827e43970 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:51.043191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37f44d93-531c-4700-83d9-4e8827e43970 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:51.043635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37f44d93-531c-4700-83d9-4e8827e43970 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:51.044421 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37f44d93-531c-4700-83d9-4e8827e43970 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:51.044850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37f44d93-531c-4700-83d9-4e8827e43970 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:51.163716 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-37f44d93-531c-4700-83d9-4e8827e43970 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:51.171100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-37f44d93-531c-4700-83d9-4e8827e43970 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138272 Jul 28 03:47:51.171648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 497/901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:51 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:51.175862 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b8e0c801-880d-40e3-9f07-ce6861dedc22 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:51.176945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b8e0c801-880d-40e3-9f07-ce6861dedc22 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:51.182342 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b8e0c801-880d-40e3-9f07-ce6861dedc22 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:51.182782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b8e0c801-880d-40e3-9f07-ce6861dedc22 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:51.183535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b8e0c801-880d-40e3-9f07-ce6861dedc22 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:51.183984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b8e0c801-880d-40e3-9f07-ce6861dedc22 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:51.242822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b8e0c801-880d-40e3-9f07-ce6861dedc22 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:51.251672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b8e0c801-880d-40e3-9f07-ce6861dedc22 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:51.253183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b8e0c801-880d-40e3-9f07-ce6861dedc22 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:51.254279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b8e0c801-880d-40e3-9f07-ce6861dedc22 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081702 Jul 28 03:47:51.255506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 498/902] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:51 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:52.188100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4fcfbf07-a0f9-4fc2-bb72-8b96f14f9008 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:52.188757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4fcfbf07-a0f9-4fc2-bb72-8b96f14f9008 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:52.195137 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fcfbf07-a0f9-4fc2-bb72-8b96f14f9008 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:52.195580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fcfbf07-a0f9-4fc2-bb72-8b96f14f9008 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:52.196367 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fcfbf07-a0f9-4fc2-bb72-8b96f14f9008 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:52.196794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fcfbf07-a0f9-4fc2-bb72-8b96f14f9008 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:52.316950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4fcfbf07-a0f9-4fc2-bb72-8b96f14f9008 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:52.325401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4fcfbf07-a0f9-4fc2-bb72-8b96f14f9008 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140976 Jul 28 03:47:52.325957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 499/903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:52 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:52.330126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-60f9611f-d2f5-4ed2-886b-a2fcf51a920e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:52.330716 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-60f9611f-d2f5-4ed2-886b-a2fcf51a920e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:52.336441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-60f9611f-d2f5-4ed2-886b-a2fcf51a920e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:52.336882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-60f9611f-d2f5-4ed2-886b-a2fcf51a920e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:52.337631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-60f9611f-d2f5-4ed2-886b-a2fcf51a920e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:52.338058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-60f9611f-d2f5-4ed2-886b-a2fcf51a920e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:52.398051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-60f9611f-d2f5-4ed2-886b-a2fcf51a920e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:52.405929 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-60f9611f-d2f5-4ed2-886b-a2fcf51a920e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:52.407424 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-60f9611f-d2f5-4ed2-886b-a2fcf51a920e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:52.408542 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-60f9611f-d2f5-4ed2-886b-a2fcf51a920e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081684 Jul 28 03:47:52.409087 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 500/904] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:52 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:53.342510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c7769035-afa5-420d-aadf-96a19548dd72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:53.343127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c7769035-afa5-420d-aadf-96a19548dd72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:53.349228 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c7769035-afa5-420d-aadf-96a19548dd72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:53.349674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c7769035-afa5-420d-aadf-96a19548dd72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:53.350442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c7769035-afa5-420d-aadf-96a19548dd72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:53.350876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c7769035-afa5-420d-aadf-96a19548dd72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:53.477648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c7769035-afa5-420d-aadf-96a19548dd72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:53.484846 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c7769035-afa5-420d-aadf-96a19548dd72 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.146049 Jul 28 03:47:53.485411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 501/905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:53 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:53.490249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5bfbea8d-3be6-4cb2-92c5-78a3891c7b3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:53.490855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5bfbea8d-3be6-4cb2-92c5-78a3891c7b3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:53.496213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bfbea8d-3be6-4cb2-92c5-78a3891c7b3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:53.496662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bfbea8d-3be6-4cb2-92c5-78a3891c7b3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:53.497432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bfbea8d-3be6-4cb2-92c5-78a3891c7b3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:53.497866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bfbea8d-3be6-4cb2-92c5-78a3891c7b3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:53.555838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5bfbea8d-3be6-4cb2-92c5-78a3891c7b3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:53.563896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5bfbea8d-3be6-4cb2-92c5-78a3891c7b3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:53.565391 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5bfbea8d-3be6-4cb2-92c5-78a3891c7b3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:53.566502 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5bfbea8d-3be6-4cb2-92c5-78a3891c7b3d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080180 Jul 28 03:47:53.567666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 502/906] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:53 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:54.502409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-178a0211-fb8a-4116-863b-b65095dcc551 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:54.503022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-178a0211-fb8a-4116-863b-b65095dcc551 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:54.508791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-178a0211-fb8a-4116-863b-b65095dcc551 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:54.509242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-178a0211-fb8a-4116-863b-b65095dcc551 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:54.510007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-178a0211-fb8a-4116-863b-b65095dcc551 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:54.510442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-178a0211-fb8a-4116-863b-b65095dcc551 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:54.631413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-178a0211-fb8a-4116-863b-b65095dcc551 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:54.638619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-178a0211-fb8a-4116-863b-b65095dcc551 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139995 Jul 28 03:47:54.639174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 503/907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:54 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:54.643337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b58947eb-8b6e-4b4d-ba93-cb346b0b36fa tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:54.643966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b58947eb-8b6e-4b4d-ba93-cb346b0b36fa tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:54.649989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b58947eb-8b6e-4b4d-ba93-cb346b0b36fa tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:54.650438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b58947eb-8b6e-4b4d-ba93-cb346b0b36fa tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:54.651196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b58947eb-8b6e-4b4d-ba93-cb346b0b36fa tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:54.651625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b58947eb-8b6e-4b4d-ba93-cb346b0b36fa tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:54.709580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b58947eb-8b6e-4b4d-ba93-cb346b0b36fa tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:54.717514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b58947eb-8b6e-4b4d-ba93-cb346b0b36fa tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:54.718999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b58947eb-8b6e-4b4d-ba93-cb346b0b36fa tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:54.720141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b58947eb-8b6e-4b4d-ba93-cb346b0b36fa tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080017 Jul 28 03:47:54.720687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 504/908] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:54 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:55.656302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5e7c88d5-38ac-4bb2-aae8-870764ec7f47 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:55.656965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5e7c88d5-38ac-4bb2-aae8-870764ec7f47 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:55.663377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e7c88d5-38ac-4bb2-aae8-870764ec7f47 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:55.663852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e7c88d5-38ac-4bb2-aae8-870764ec7f47 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:55.664615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e7c88d5-38ac-4bb2-aae8-870764ec7f47 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:55.665045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e7c88d5-38ac-4bb2-aae8-870764ec7f47 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:55.783285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5e7c88d5-38ac-4bb2-aae8-870764ec7f47 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:55.791101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5e7c88d5-38ac-4bb2-aae8-870764ec7f47 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138515 Jul 28 03:47:55.791652 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 505/909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:55 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:55.795915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ceabe276-cdb3-44b9-b78c-2bb9f8cc94e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:55.796577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ceabe276-cdb3-44b9-b78c-2bb9f8cc94e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:55.801785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ceabe276-cdb3-44b9-b78c-2bb9f8cc94e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:55.802228 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ceabe276-cdb3-44b9-b78c-2bb9f8cc94e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:55.802987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ceabe276-cdb3-44b9-b78c-2bb9f8cc94e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:55.803423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ceabe276-cdb3-44b9-b78c-2bb9f8cc94e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:55.865792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ceabe276-cdb3-44b9-b78c-2bb9f8cc94e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:55.873909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ceabe276-cdb3-44b9-b78c-2bb9f8cc94e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:55.875543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ceabe276-cdb3-44b9-b78c-2bb9f8cc94e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:55.876507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ceabe276-cdb3-44b9-b78c-2bb9f8cc94e8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.083925 Jul 28 03:47:55.877054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 506/910] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:55 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:56.808017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-73571d01-3ec7-444f-a432-8307e47badc8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:56.808689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-73571d01-3ec7-444f-a432-8307e47badc8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:56.814449 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73571d01-3ec7-444f-a432-8307e47badc8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:56.814900 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73571d01-3ec7-444f-a432-8307e47badc8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:56.815666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73571d01-3ec7-444f-a432-8307e47badc8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:56.816127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73571d01-3ec7-444f-a432-8307e47badc8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:56.933110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-73571d01-3ec7-444f-a432-8307e47badc8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:56.940375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-73571d01-3ec7-444f-a432-8307e47badc8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.136028 Jul 28 03:47:56.940935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 507/911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:56 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:56.945871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1edd49d0-5b10-428b-8a89-05db3c370131 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:56.946504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1edd49d0-5b10-428b-8a89-05db3c370131 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:56.951778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1edd49d0-5b10-428b-8a89-05db3c370131 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:56.952224 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1edd49d0-5b10-428b-8a89-05db3c370131 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:56.952982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1edd49d0-5b10-428b-8a89-05db3c370131 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:56.953414 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1edd49d0-5b10-428b-8a89-05db3c370131 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:57.012397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1edd49d0-5b10-428b-8a89-05db3c370131 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:57.020990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1edd49d0-5b10-428b-8a89-05db3c370131 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:57.022473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1edd49d0-5b10-428b-8a89-05db3c370131 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:57.023577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1edd49d0-5b10-428b-8a89-05db3c370131 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081735 Jul 28 03:47:57.024151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 508/912] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:56 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:57.957013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8771d097-dc98-408a-a3de-d02ae47c1a7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:57.957733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8771d097-dc98-408a-a3de-d02ae47c1a7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:57.963531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8771d097-dc98-408a-a3de-d02ae47c1a7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:57.964023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8771d097-dc98-408a-a3de-d02ae47c1a7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:57.964783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8771d097-dc98-408a-a3de-d02ae47c1a7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:57.965218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8771d097-dc98-408a-a3de-d02ae47c1a7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:58.083547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8771d097-dc98-408a-a3de-d02ae47c1a7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:58.090775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8771d097-dc98-408a-a3de-d02ae47c1a7b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137393 Jul 28 03:47:58.091326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 509/913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:57 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:58.095616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5b2037ef-565b-4994-93e7-83f48ad8d44f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:58.096241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5b2037ef-565b-4994-93e7-83f48ad8d44f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:58.101854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b2037ef-565b-4994-93e7-83f48ad8d44f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:58.102302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b2037ef-565b-4994-93e7-83f48ad8d44f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:58.103063 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b2037ef-565b-4994-93e7-83f48ad8d44f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:58.103498 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b2037ef-565b-4994-93e7-83f48ad8d44f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:58.166178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5b2037ef-565b-4994-93e7-83f48ad8d44f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:58.174483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5b2037ef-565b-4994-93e7-83f48ad8d44f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:58.175995 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5b2037ef-565b-4994-93e7-83f48ad8d44f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:58.177750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5b2037ef-565b-4994-93e7-83f48ad8d44f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.085478 Jul 28 03:47:58.178296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 510/914] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:58 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:59.108533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3d202566-0180-45e0-ac64-9bb4302144d1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:59.109211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3d202566-0180-45e0-ac64-9bb4302144d1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:59.115551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d202566-0180-45e0-ac64-9bb4302144d1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:59.116024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d202566-0180-45e0-ac64-9bb4302144d1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:59.116782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d202566-0180-45e0-ac64-9bb4302144d1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:59.117210 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d202566-0180-45e0-ac64-9bb4302144d1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:59.235943 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3d202566-0180-45e0-ac64-9bb4302144d1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:59.243945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3d202566-0180-45e0-ac64-9bb4302144d1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.138962 Jul 28 03:47:59.244503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 511/915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:47:59 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:59.248837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eb8bba44-d792-4f31-ac81-94a8854cf34e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:59.249438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eb8bba44-d792-4f31-ac81-94a8854cf34e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:47:59.255273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb8bba44-d792-4f31-ac81-94a8854cf34e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:59.255803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb8bba44-d792-4f31-ac81-94a8854cf34e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:59.256537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb8bba44-d792-4f31-ac81-94a8854cf34e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:47:59.256978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb8bba44-d792-4f31-ac81-94a8854cf34e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:47:59.314764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eb8bba44-d792-4f31-ac81-94a8854cf34e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:59.323318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eb8bba44-d792-4f31-ac81-94a8854cf34e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:59.324853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eb8bba44-d792-4f31-ac81-94a8854cf34e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:59.325965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eb8bba44-d792-4f31-ac81-94a8854cf34e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080548 Jul 28 03:47:59.326512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 512/916] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:47:59 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:00.260810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7ce6826d-3a29-48f5-a9de-caf051b7bf9f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:00.261383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7ce6826d-3a29-48f5-a9de-caf051b7bf9f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:00.267138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ce6826d-3a29-48f5-a9de-caf051b7bf9f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:00.267581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ce6826d-3a29-48f5-a9de-caf051b7bf9f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:00.268394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ce6826d-3a29-48f5-a9de-caf051b7bf9f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:00.268824 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ce6826d-3a29-48f5-a9de-caf051b7bf9f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:00.389449 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7ce6826d-3a29-48f5-a9de-caf051b7bf9f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:00.397341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7ce6826d-3a29-48f5-a9de-caf051b7bf9f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140217 Jul 28 03:48:00.397907 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 513/917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:00 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:00.402089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-47a633ab-e213-4146-8eb8-fd0678770ab2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:00.402692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-47a633ab-e213-4146-8eb8-fd0678770ab2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:00.408028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47a633ab-e213-4146-8eb8-fd0678770ab2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:00.408483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47a633ab-e213-4146-8eb8-fd0678770ab2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:00.409255 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47a633ab-e213-4146-8eb8-fd0678770ab2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:00.409696 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47a633ab-e213-4146-8eb8-fd0678770ab2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:00.469697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-47a633ab-e213-4146-8eb8-fd0678770ab2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:00.478989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-47a633ab-e213-4146-8eb8-fd0678770ab2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:00.480492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-47a633ab-e213-4146-8eb8-fd0678770ab2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:00.481590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-47a633ab-e213-4146-8eb8-fd0678770ab2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082777 Jul 28 03:48:00.482130 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 514/918] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:00 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:01.414613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2cecd8cc-fc43-4765-8346-5ed50e08fdde tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:01.415261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2cecd8cc-fc43-4765-8346-5ed50e08fdde tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:01.420927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cecd8cc-fc43-4765-8346-5ed50e08fdde tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:01.421369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cecd8cc-fc43-4765-8346-5ed50e08fdde tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:01.422119 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cecd8cc-fc43-4765-8346-5ed50e08fdde tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:01.422543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cecd8cc-fc43-4765-8346-5ed50e08fdde tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:01.540078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2cecd8cc-fc43-4765-8346-5ed50e08fdde tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:01.547304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2cecd8cc-fc43-4765-8346-5ed50e08fdde tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137017 Jul 28 03:48:01.547883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 515/919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:01 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:01.552582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5e9ec2bb-4f4f-4ff6-bb61-209d74e1c36b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:01.553179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5e9ec2bb-4f4f-4ff6-bb61-209d74e1c36b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:01.558501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e9ec2bb-4f4f-4ff6-bb61-209d74e1c36b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:01.558946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e9ec2bb-4f4f-4ff6-bb61-209d74e1c36b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:01.559725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e9ec2bb-4f4f-4ff6-bb61-209d74e1c36b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:01.560161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5e9ec2bb-4f4f-4ff6-bb61-209d74e1c36b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:01.618556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5e9ec2bb-4f4f-4ff6-bb61-209d74e1c36b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:01.626589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5e9ec2bb-4f4f-4ff6-bb61-209d74e1c36b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:01.628091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5e9ec2bb-4f4f-4ff6-bb61-209d74e1c36b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:01.629198 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5e9ec2bb-4f4f-4ff6-bb61-209d74e1c36b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080404 Jul 28 03:48:01.629748 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 516/920] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:01 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:02.565422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7f59bbc0-a467-43ad-ab92-dee5d4caae1a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:02.566089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7f59bbc0-a467-43ad-ab92-dee5d4caae1a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:02.572473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f59bbc0-a467-43ad-ab92-dee5d4caae1a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:02.572924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f59bbc0-a467-43ad-ab92-dee5d4caae1a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:02.573689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f59bbc0-a467-43ad-ab92-dee5d4caae1a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:02.574122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f59bbc0-a467-43ad-ab92-dee5d4caae1a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:02.694784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7f59bbc0-a467-43ad-ab92-dee5d4caae1a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:02.701932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7f59bbc0-a467-43ad-ab92-dee5d4caae1a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140342 Jul 28 03:48:02.702488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 517/921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:02 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:02.706680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2ef7717b-d587-4d42-b463-d5f87540d533 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:02.707316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2ef7717b-d587-4d42-b463-d5f87540d533 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:02.712766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ef7717b-d587-4d42-b463-d5f87540d533 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:02.713216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ef7717b-d587-4d42-b463-d5f87540d533 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:02.713976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ef7717b-d587-4d42-b463-d5f87540d533 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:02.714429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ef7717b-d587-4d42-b463-d5f87540d533 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:02.772873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2ef7717b-d587-4d42-b463-d5f87540d533 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:02.780885 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2ef7717b-d587-4d42-b463-d5f87540d533 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:02.782395 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2ef7717b-d587-4d42-b463-d5f87540d533 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:02.783500 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2ef7717b-d587-4d42-b463-d5f87540d533 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080105 Jul 28 03:48:02.784089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 518/922] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:02 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:03.719053 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-baf87c02-c47e-44af-a5e5-3c30bb59f171 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:03.719744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-baf87c02-c47e-44af-a5e5-3c30bb59f171 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:03.725820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-baf87c02-c47e-44af-a5e5-3c30bb59f171 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:03.726268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-baf87c02-c47e-44af-a5e5-3c30bb59f171 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:03.727029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-baf87c02-c47e-44af-a5e5-3c30bb59f171 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:03.727460 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-baf87c02-c47e-44af-a5e5-3c30bb59f171 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:03.843814 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-baf87c02-c47e-44af-a5e5-3c30bb59f171 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:03.851313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-baf87c02-c47e-44af-a5e5-3c30bb59f171 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.135906 Jul 28 03:48:03.851910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 519/923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:03 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:03.856095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2b022ed2-739a-49e0-b161-aa1faffcdf95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:03.856690 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2b022ed2-739a-49e0-b161-aa1faffcdf95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:03.862264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b022ed2-739a-49e0-b161-aa1faffcdf95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:03.862711 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b022ed2-739a-49e0-b161-aa1faffcdf95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:03.863633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b022ed2-739a-49e0-b161-aa1faffcdf95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:03.864136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b022ed2-739a-49e0-b161-aa1faffcdf95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:03.925822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2b022ed2-739a-49e0-b161-aa1faffcdf95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:03.934488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2b022ed2-739a-49e0-b161-aa1faffcdf95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:03.935997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2b022ed2-739a-49e0-b161-aa1faffcdf95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:03.937107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2b022ed2-739a-49e0-b161-aa1faffcdf95 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084286 Jul 28 03:48:03.937654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 520/924] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:03 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:04.869034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9ef44dc0-713d-499d-b817-a34382d59316 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:04.869683 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9ef44dc0-713d-499d-b817-a34382d59316 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:04.875429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef44dc0-713d-499d-b817-a34382d59316 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:04.875912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef44dc0-713d-499d-b817-a34382d59316 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:04.876673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef44dc0-713d-499d-b817-a34382d59316 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:04.877105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef44dc0-713d-499d-b817-a34382d59316 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:04.993795 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9ef44dc0-713d-499d-b817-a34382d59316 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:05.000971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9ef44dc0-713d-499d-b817-a34382d59316 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.135685 Jul 28 03:48:05.001527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 521/925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:04 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:05.006344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-11e42d68-411a-4268-a477-9006da7ecf62 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:05.006938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-11e42d68-411a-4268-a477-9006da7ecf62 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:05.012252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11e42d68-411a-4268-a477-9006da7ecf62 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:05.012701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11e42d68-411a-4268-a477-9006da7ecf62 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:05.013468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11e42d68-411a-4268-a477-9006da7ecf62 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:05.013899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11e42d68-411a-4268-a477-9006da7ecf62 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:05.072734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-11e42d68-411a-4268-a477-9006da7ecf62 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:05.080873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-11e42d68-411a-4268-a477-9006da7ecf62 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:05.083025 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-11e42d68-411a-4268-a477-9006da7ecf62 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:05.084174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-11e42d68-411a-4268-a477-9006da7ecf62 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081730 Jul 28 03:48:05.084723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 522/926] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:05 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:06.018085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b540757d-d2f4-4054-8dd2-30b272d967ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:06.018689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b540757d-d2f4-4054-8dd2-30b272d967ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:06.024631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b540757d-d2f4-4054-8dd2-30b272d967ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:06.025070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b540757d-d2f4-4054-8dd2-30b272d967ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:06.025821 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b540757d-d2f4-4054-8dd2-30b272d967ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:06.026248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b540757d-d2f4-4054-8dd2-30b272d967ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:06.144309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b540757d-d2f4-4054-8dd2-30b272d967ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:06.151453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b540757d-d2f4-4054-8dd2-30b272d967ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137126 Jul 28 03:48:06.152039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 523/927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:06 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:06.156360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9bd21d04-6591-4611-b566-f5e317042f51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:06.157122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9bd21d04-6591-4611-b566-f5e317042f51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:06.163498 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9bd21d04-6591-4611-b566-f5e317042f51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:06.163971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9bd21d04-6591-4611-b566-f5e317042f51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:06.164734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9bd21d04-6591-4611-b566-f5e317042f51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:06.165171 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9bd21d04-6591-4611-b566-f5e317042f51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:06.227482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9bd21d04-6591-4611-b566-f5e317042f51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:06.235489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9bd21d04-6591-4611-b566-f5e317042f51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:06.236988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9bd21d04-6591-4611-b566-f5e317042f51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:06.238077 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9bd21d04-6591-4611-b566-f5e317042f51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.085140 Jul 28 03:48:06.238661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 524/928] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:06 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:07.169136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c89f307e-bf53-4ac8-a800-d465bf3b717f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:07.169792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c89f307e-bf53-4ac8-a800-d465bf3b717f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:07.176618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c89f307e-bf53-4ac8-a800-d465bf3b717f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:07.177039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c89f307e-bf53-4ac8-a800-d465bf3b717f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:07.177804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c89f307e-bf53-4ac8-a800-d465bf3b717f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:07.178243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c89f307e-bf53-4ac8-a800-d465bf3b717f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:07.304422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c89f307e-bf53-4ac8-a800-d465bf3b717f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:07.314129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c89f307e-bf53-4ac8-a800-d465bf3b717f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.148567 Jul 28 03:48:07.315090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 525/929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:07 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:07.322732 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9ef5f2ae-7ec8-4b59-b496-583694fb82b5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:07.323364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9ef5f2ae-7ec8-4b59-b496-583694fb82b5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:07.330813 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef5f2ae-7ec8-4b59-b496-583694fb82b5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:07.331262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef5f2ae-7ec8-4b59-b496-583694fb82b5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:07.332072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef5f2ae-7ec8-4b59-b496-583694fb82b5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:07.332752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef5f2ae-7ec8-4b59-b496-583694fb82b5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:07.400579 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9ef5f2ae-7ec8-4b59-b496-583694fb82b5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:07.409418 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9ef5f2ae-7ec8-4b59-b496-583694fb82b5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:07.411966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9ef5f2ae-7ec8-4b59-b496-583694fb82b5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:07.413881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9ef5f2ae-7ec8-4b59-b496-583694fb82b5 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.097100 Jul 28 03:48:07.414813 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 526/930] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:07 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:08.331640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-54c38bc1-24fc-4669-9972-483c1fda34ab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:08.332826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-54c38bc1-24fc-4669-9972-483c1fda34ab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:08.338691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54c38bc1-24fc-4669-9972-483c1fda34ab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:08.339133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54c38bc1-24fc-4669-9972-483c1fda34ab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:08.339924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54c38bc1-24fc-4669-9972-483c1fda34ab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:08.340358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54c38bc1-24fc-4669-9972-483c1fda34ab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:08.460544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-54c38bc1-24fc-4669-9972-483c1fda34ab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:08.467726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-54c38bc1-24fc-4669-9972-483c1fda34ab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139753 Jul 28 03:48:08.468282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 527/931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:08 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:08.472612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-76c39803-4741-417d-8ff8-fee51d1f8ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:08.473214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-76c39803-4741-417d-8ff8-fee51d1f8ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:08.478730 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76c39803-4741-417d-8ff8-fee51d1f8ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:08.479181 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76c39803-4741-417d-8ff8-fee51d1f8ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:08.479977 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76c39803-4741-417d-8ff8-fee51d1f8ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:08.480417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76c39803-4741-417d-8ff8-fee51d1f8ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:08.538757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-76c39803-4741-417d-8ff8-fee51d1f8ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:08.546741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-76c39803-4741-417d-8ff8-fee51d1f8ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:08.548268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-76c39803-4741-417d-8ff8-fee51d1f8ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:08.549379 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-76c39803-4741-417d-8ff8-fee51d1f8ad8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080184 Jul 28 03:48:08.549928 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 528/932] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:08 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:09.484668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-adb1f4a7-a5a7-4dd6-b97a-1d529f147288 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:09.485307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-adb1f4a7-a5a7-4dd6-b97a-1d529f147288 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:09.491031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-adb1f4a7-a5a7-4dd6-b97a-1d529f147288 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:09.491479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-adb1f4a7-a5a7-4dd6-b97a-1d529f147288 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:09.492270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-adb1f4a7-a5a7-4dd6-b97a-1d529f147288 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:09.492701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-adb1f4a7-a5a7-4dd6-b97a-1d529f147288 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:09.610140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-adb1f4a7-a5a7-4dd6-b97a-1d529f147288 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:09.617322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-adb1f4a7-a5a7-4dd6-b97a-1d529f147288 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.136468 Jul 28 03:48:09.617877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 529/933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:09 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:09.622171 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-49e41525-d96b-42bb-811e-9b26d3a1912c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:09.622770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-49e41525-d96b-42bb-811e-9b26d3a1912c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:09.628054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49e41525-d96b-42bb-811e-9b26d3a1912c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:09.628508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49e41525-d96b-42bb-811e-9b26d3a1912c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:09.629791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49e41525-d96b-42bb-811e-9b26d3a1912c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:09.630227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49e41525-d96b-42bb-811e-9b26d3a1912c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:09.687934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-49e41525-d96b-42bb-811e-9b26d3a1912c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:09.696506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-49e41525-d96b-42bb-811e-9b26d3a1912c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:09.697984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-49e41525-d96b-42bb-811e-9b26d3a1912c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:09.699079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-49e41525-d96b-42bb-811e-9b26d3a1912c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080290 Jul 28 03:48:09.699624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 530/934] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:09 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:10.634899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b061372e-6290-4ff8-8b09-240ab978587f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:10.635565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b061372e-6290-4ff8-8b09-240ab978587f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:10.641313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b061372e-6290-4ff8-8b09-240ab978587f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:10.641752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b061372e-6290-4ff8-8b09-240ab978587f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:10.642504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b061372e-6290-4ff8-8b09-240ab978587f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:10.642933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b061372e-6290-4ff8-8b09-240ab978587f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:10.764546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b061372e-6290-4ff8-8b09-240ab978587f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:10.771923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b061372e-6290-4ff8-8b09-240ab978587f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140669 Jul 28 03:48:10.772485 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 531/935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:10 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:10.776716 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f8a070e4-bd5b-4d5c-9216-c26346a26a1d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:10.777396 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f8a070e4-bd5b-4d5c-9216-c26346a26a1d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:10.782592 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8a070e4-bd5b-4d5c-9216-c26346a26a1d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:10.783036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8a070e4-bd5b-4d5c-9216-c26346a26a1d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:10.783825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8a070e4-bd5b-4d5c-9216-c26346a26a1d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:10.784262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8a070e4-bd5b-4d5c-9216-c26346a26a1d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:10.842573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f8a070e4-bd5b-4d5c-9216-c26346a26a1d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:10.851086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f8a070e4-bd5b-4d5c-9216-c26346a26a1d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:10.852612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f8a070e4-bd5b-4d5c-9216-c26346a26a1d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:10.853725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f8a070e4-bd5b-4d5c-9216-c26346a26a1d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080332 Jul 28 03:48:10.854273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 532/936] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:10 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:11.789944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e48103b6-3c9f-425a-aaf2-dbb3689b0bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:11.790614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e48103b6-3c9f-425a-aaf2-dbb3689b0bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:11.796458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e48103b6-3c9f-425a-aaf2-dbb3689b0bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:11.796909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e48103b6-3c9f-425a-aaf2-dbb3689b0bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:11.797673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e48103b6-3c9f-425a-aaf2-dbb3689b0bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:11.798107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e48103b6-3c9f-425a-aaf2-dbb3689b0bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:11.917394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e48103b6-3c9f-425a-aaf2-dbb3689b0bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:11.924606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e48103b6-3c9f-425a-aaf2-dbb3689b0bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139200 Jul 28 03:48:11.925158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 533/937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:11 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:11.929558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-84fb5cd0-1558-4291-82a6-51028891909b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:11.930157 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-84fb5cd0-1558-4291-82a6-51028891909b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:11.935576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84fb5cd0-1558-4291-82a6-51028891909b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:11.936054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84fb5cd0-1558-4291-82a6-51028891909b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:11.936819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84fb5cd0-1558-4291-82a6-51028891909b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:11.937253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84fb5cd0-1558-4291-82a6-51028891909b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:11.998558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-84fb5cd0-1558-4291-82a6-51028891909b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:12.007145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-84fb5cd0-1558-4291-82a6-51028891909b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:12.008660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-84fb5cd0-1558-4291-82a6-51028891909b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:12.009774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-84fb5cd0-1558-4291-82a6-51028891909b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.083705 Jul 28 03:48:12.010325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 534/938] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:11 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:12.941274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-10b53cf0-1e8a-40e6-ab51-7942d406eae8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:12.941994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-10b53cf0-1e8a-40e6-ab51-7942d406eae8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:12.947857 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10b53cf0-1e8a-40e6-ab51-7942d406eae8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:12.948302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10b53cf0-1e8a-40e6-ab51-7942d406eae8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:12.949059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10b53cf0-1e8a-40e6-ab51-7942d406eae8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:12.949489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10b53cf0-1e8a-40e6-ab51-7942d406eae8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:13.277273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-10b53cf0-1e8a-40e6-ab51-7942d406eae8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:13.284414 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-10b53cf0-1e8a-40e6-ab51-7942d406eae8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.346780 Jul 28 03:48:13.284975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 535/939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:12 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:13.290028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-34b79901-e529-4735-9958-cb8ad4c33567 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:13.290627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-34b79901-e529-4735-9958-cb8ad4c33567 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:13.295979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34b79901-e529-4735-9958-cb8ad4c33567 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:13.296432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34b79901-e529-4735-9958-cb8ad4c33567 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:13.297202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34b79901-e529-4735-9958-cb8ad4c33567 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:13.297647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34b79901-e529-4735-9958-cb8ad4c33567 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:13.357277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-34b79901-e529-4735-9958-cb8ad4c33567 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:13.365385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-34b79901-e529-4735-9958-cb8ad4c33567 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:13.366876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-34b79901-e529-4735-9958-cb8ad4c33567 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:13.368082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-34b79901-e529-4735-9958-cb8ad4c33567 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081401 Jul 28 03:48:13.368659 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 536/940] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:13 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:14.302445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8ba2ce08-c760-46c3-be78-397c94d1a0ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:14.303031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8ba2ce08-c760-46c3-be78-397c94d1a0ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:14.308812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8ba2ce08-c760-46c3-be78-397c94d1a0ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:14.309260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8ba2ce08-c760-46c3-be78-397c94d1a0ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:14.310021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8ba2ce08-c760-46c3-be78-397c94d1a0ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:14.310461 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8ba2ce08-c760-46c3-be78-397c94d1a0ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:14.427841 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8ba2ce08-c760-46c3-be78-397c94d1a0ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:14.435350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8ba2ce08-c760-46c3-be78-397c94d1a0ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137287 Jul 28 03:48:14.435939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 537/941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:14 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:14.440099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3bb80d94-29b7-4d20-8845-b3aaad496c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:14.440687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3bb80d94-29b7-4d20-8845-b3aaad496c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:14.446132 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bb80d94-29b7-4d20-8845-b3aaad496c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:14.446570 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bb80d94-29b7-4d20-8845-b3aaad496c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:14.447323 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bb80d94-29b7-4d20-8845-b3aaad496c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:14.447770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bb80d94-29b7-4d20-8845-b3aaad496c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:14.509082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3bb80d94-29b7-4d20-8845-b3aaad496c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:14.517071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3bb80d94-29b7-4d20-8845-b3aaad496c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:14.518540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3bb80d94-29b7-4d20-8845-b3aaad496c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:14.519632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3bb80d94-29b7-4d20-8845-b3aaad496c5c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082790 Jul 28 03:48:14.520830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 538/942] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:14 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:15.452654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-db3a22bc-4c7b-435e-b5f8-fbb0fa2b022e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:15.453275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-db3a22bc-4c7b-435e-b5f8-fbb0fa2b022e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:15.459582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db3a22bc-4c7b-435e-b5f8-fbb0fa2b022e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:15.460052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db3a22bc-4c7b-435e-b5f8-fbb0fa2b022e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:15.460817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db3a22bc-4c7b-435e-b5f8-fbb0fa2b022e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:15.461249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db3a22bc-4c7b-435e-b5f8-fbb0fa2b022e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:15.585673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-db3a22bc-4c7b-435e-b5f8-fbb0fa2b022e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:15.592899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-db3a22bc-4c7b-435e-b5f8-fbb0fa2b022e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.144003 Jul 28 03:48:15.593487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 539/943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:15 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:15.597694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1edf4021-3433-45aa-be4c-f868ab350e9c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:15.598556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1edf4021-3433-45aa-be4c-f868ab350e9c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:15.604108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1edf4021-3433-45aa-be4c-f868ab350e9c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:15.604562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1edf4021-3433-45aa-be4c-f868ab350e9c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:15.605339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1edf4021-3433-45aa-be4c-f868ab350e9c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:15.605775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1edf4021-3433-45aa-be4c-f868ab350e9c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:15.664035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1edf4021-3433-45aa-be4c-f868ab350e9c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:15.672193 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1edf4021-3433-45aa-be4c-f868ab350e9c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:15.673695 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1edf4021-3433-45aa-be4c-f868ab350e9c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:15.674807 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1edf4021-3433-45aa-be4c-f868ab350e9c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080402 Jul 28 03:48:15.675358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 540/944] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:15 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:16.610258 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d03db010-09b5-40fd-b5ce-780c582e802c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:16.610867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d03db010-09b5-40fd-b5ce-780c582e802c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:16.617407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d03db010-09b5-40fd-b5ce-780c582e802c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:16.617854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d03db010-09b5-40fd-b5ce-780c582e802c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:16.618616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d03db010-09b5-40fd-b5ce-780c582e802c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:16.619046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d03db010-09b5-40fd-b5ce-780c582e802c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:16.736058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d03db010-09b5-40fd-b5ce-780c582e802c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:16.743689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d03db010-09b5-40fd-b5ce-780c582e802c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137129 Jul 28 03:48:16.744285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 541/945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:16 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:16.748553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-29174f2c-e2a8-4117-958e-cb6011d7ec51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:16.749148 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-29174f2c-e2a8-4117-958e-cb6011d7ec51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:16.754965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29174f2c-e2a8-4117-958e-cb6011d7ec51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:16.755408 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29174f2c-e2a8-4117-958e-cb6011d7ec51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:16.756200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29174f2c-e2a8-4117-958e-cb6011d7ec51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:16.756627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29174f2c-e2a8-4117-958e-cb6011d7ec51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:16.818181 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-29174f2c-e2a8-4117-958e-cb6011d7ec51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:16.826253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-29174f2c-e2a8-4117-958e-cb6011d7ec51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:16.827775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-29174f2c-e2a8-4117-958e-cb6011d7ec51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:16.828886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-29174f2c-e2a8-4117-958e-cb6011d7ec51 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.083661 Jul 28 03:48:16.829447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 542/946] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:16 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:17.760793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-13326b4f-104a-4570-9c2f-7c87c47e3a73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:17.761437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-13326b4f-104a-4570-9c2f-7c87c47e3a73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:17.767091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-13326b4f-104a-4570-9c2f-7c87c47e3a73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:17.767544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-13326b4f-104a-4570-9c2f-7c87c47e3a73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:17.768341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-13326b4f-104a-4570-9c2f-7c87c47e3a73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:17.768789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-13326b4f-104a-4570-9c2f-7c87c47e3a73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:17.890672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-13326b4f-104a-4570-9c2f-7c87c47e3a73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:17.899199 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-13326b4f-104a-4570-9c2f-7c87c47e3a73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.142136 Jul 28 03:48:17.899769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 543/947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:17 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:17.903917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8099b8b3-3840-4964-b7ee-dce8f4bc3a1f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:17.904510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8099b8b3-3840-4964-b7ee-dce8f4bc3a1f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:17.909796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8099b8b3-3840-4964-b7ee-dce8f4bc3a1f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:17.910242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8099b8b3-3840-4964-b7ee-dce8f4bc3a1f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:17.911330 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8099b8b3-3840-4964-b7ee-dce8f4bc3a1f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:17.911784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8099b8b3-3840-4964-b7ee-dce8f4bc3a1f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:17.969925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8099b8b3-3840-4964-b7ee-dce8f4bc3a1f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:17.978374 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8099b8b3-3840-4964-b7ee-dce8f4bc3a1f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:17.979885 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8099b8b3-3840-4964-b7ee-dce8f4bc3a1f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:17.980983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8099b8b3-3840-4964-b7ee-dce8f4bc3a1f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080307 Jul 28 03:48:17.981528 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 544/948] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:17 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:18.916320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-27422ce0-bbb1-4e79-95bd-6e32785de392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:18.916969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-27422ce0-bbb1-4e79-95bd-6e32785de392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:18.922684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-27422ce0-bbb1-4e79-95bd-6e32785de392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:18.923143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-27422ce0-bbb1-4e79-95bd-6e32785de392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:18.923912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-27422ce0-bbb1-4e79-95bd-6e32785de392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:18.924343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-27422ce0-bbb1-4e79-95bd-6e32785de392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:19.045541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-27422ce0-bbb1-4e79-95bd-6e32785de392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:19.053768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-27422ce0-bbb1-4e79-95bd-6e32785de392 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.141102 Jul 28 03:48:19.054322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 545/949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:18 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:19.058468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fc7d6e4c-e945-4971-8016-dbc77481fcf7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:19.059062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fc7d6e4c-e945-4971-8016-dbc77481fcf7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:19.064380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc7d6e4c-e945-4971-8016-dbc77481fcf7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:19.064823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc7d6e4c-e945-4971-8016-dbc77481fcf7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:19.065577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc7d6e4c-e945-4971-8016-dbc77481fcf7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:19.066004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc7d6e4c-e945-4971-8016-dbc77481fcf7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:19.125975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fc7d6e4c-e945-4971-8016-dbc77481fcf7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:19.134658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fc7d6e4c-e945-4971-8016-dbc77481fcf7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:19.136176 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fc7d6e4c-e945-4971-8016-dbc77481fcf7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:19.137272 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fc7d6e4c-e945-4971-8016-dbc77481fcf7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082048 Jul 28 03:48:19.137817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 546/950] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:19 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:20.071223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f6805191-a88b-43d5-a434-785029c1699e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:20.071847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f6805191-a88b-43d5-a434-785029c1699e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:20.077696 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f6805191-a88b-43d5-a434-785029c1699e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:20.078146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f6805191-a88b-43d5-a434-785029c1699e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:20.078916 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f6805191-a88b-43d5-a434-785029c1699e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:20.079351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f6805191-a88b-43d5-a434-785029c1699e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:20.199405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f6805191-a88b-43d5-a434-785029c1699e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:20.206638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f6805191-a88b-43d5-a434-785029c1699e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.139681 Jul 28 03:48:20.208135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 547/951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:20 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:20.212190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c6772ac0-1dc1-469e-abe4-e98aa912b260 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:20.212793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c6772ac0-1dc1-469e-abe4-e98aa912b260 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:20.218259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6772ac0-1dc1-469e-abe4-e98aa912b260 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:20.218706 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6772ac0-1dc1-469e-abe4-e98aa912b260 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:20.219472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6772ac0-1dc1-469e-abe4-e98aa912b260 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:20.219944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6772ac0-1dc1-469e-abe4-e98aa912b260 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:20.278215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c6772ac0-1dc1-469e-abe4-e98aa912b260 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:20.286505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c6772ac0-1dc1-469e-abe4-e98aa912b260 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:20.288024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c6772ac0-1dc1-469e-abe4-e98aa912b260 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:20.289134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c6772ac0-1dc1-469e-abe4-e98aa912b260 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080215 Jul 28 03:48:20.289695 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 548/952] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:20 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:21.225188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cef60ef8-80ab-4906-a968-98c674cdf8c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:21.225846 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cef60ef8-80ab-4906-a968-98c674cdf8c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:21.231719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cef60ef8-80ab-4906-a968-98c674cdf8c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:21.232187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cef60ef8-80ab-4906-a968-98c674cdf8c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:21.232950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cef60ef8-80ab-4906-a968-98c674cdf8c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:21.233388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cef60ef8-80ab-4906-a968-98c674cdf8c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:21.356101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cef60ef8-80ab-4906-a968-98c674cdf8c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:21.363299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cef60ef8-80ab-4906-a968-98c674cdf8c4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.142694 Jul 28 03:48:21.364028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 549/953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:21 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:21.368314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1ded8294-7014-42f7-a41e-1b47a05725ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:21.368917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1ded8294-7014-42f7-a41e-1b47a05725ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:21.374317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ded8294-7014-42f7-a41e-1b47a05725ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:21.374710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ded8294-7014-42f7-a41e-1b47a05725ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:21.375521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ded8294-7014-42f7-a41e-1b47a05725ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:21.375983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ded8294-7014-42f7-a41e-1b47a05725ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:21.435010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1ded8294-7014-42f7-a41e-1b47a05725ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:21.443185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1ded8294-7014-42f7-a41e-1b47a05725ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:21.444709 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1ded8294-7014-42f7-a41e-1b47a05725ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:21.445842 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1ded8294-7014-42f7-a41e-1b47a05725ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080888 Jul 28 03:48:21.446384 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 550/954] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:21 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:22.381148 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-05fad9a5-531f-43a8-a01e-408f79fe190a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:22.381780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-05fad9a5-531f-43a8-a01e-408f79fe190a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:22.387527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-05fad9a5-531f-43a8-a01e-408f79fe190a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:22.388009 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-05fad9a5-531f-43a8-a01e-408f79fe190a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:22.388804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-05fad9a5-531f-43a8-a01e-408f79fe190a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:22.389244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-05fad9a5-531f-43a8-a01e-408f79fe190a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:22.507472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-05fad9a5-531f-43a8-a01e-408f79fe190a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:22.514679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-05fad9a5-531f-43a8-a01e-408f79fe190a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137474 Jul 28 03:48:22.515232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 551/955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:22 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:22.519417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d73d041e-6b59-4f58-b0e5-8b486a87d3be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:22.520281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d73d041e-6b59-4f58-b0e5-8b486a87d3be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:22.525710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d73d041e-6b59-4f58-b0e5-8b486a87d3be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:22.526161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d73d041e-6b59-4f58-b0e5-8b486a87d3be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:22.526925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d73d041e-6b59-4f58-b0e5-8b486a87d3be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:22.527388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d73d041e-6b59-4f58-b0e5-8b486a87d3be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:22.589725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d73d041e-6b59-4f58-b0e5-8b486a87d3be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:22.597864 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d73d041e-6b59-4f58-b0e5-8b486a87d3be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:22.600104 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d73d041e-6b59-4f58-b0e5-8b486a87d3be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:22.601219 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d73d041e-6b59-4f58-b0e5-8b486a87d3be tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.085051 Jul 28 03:48:22.601776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 552/956] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:22 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:23.531919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c96af88d-0ee5-4c1d-b694-722daa7ee479 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:23.532643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c96af88d-0ee5-4c1d-b694-722daa7ee479 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:23.539226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c96af88d-0ee5-4c1d-b694-722daa7ee479 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:23.539666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c96af88d-0ee5-4c1d-b694-722daa7ee479 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:23.540459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c96af88d-0ee5-4c1d-b694-722daa7ee479 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:23.540893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c96af88d-0ee5-4c1d-b694-722daa7ee479 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:23.672179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c96af88d-0ee5-4c1d-b694-722daa7ee479 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:23.679532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c96af88d-0ee5-4c1d-b694-722daa7ee479 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.151420 Jul 28 03:48:23.680133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 553/957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:23 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:23.684430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fc5dac56-6db3-44da-bd07-95e5f7a63893 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:23.685062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fc5dac56-6db3-44da-bd07-95e5f7a63893 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:23.690810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc5dac56-6db3-44da-bd07-95e5f7a63893 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:23.691278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc5dac56-6db3-44da-bd07-95e5f7a63893 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:23.692076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc5dac56-6db3-44da-bd07-95e5f7a63893 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:23.692507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc5dac56-6db3-44da-bd07-95e5f7a63893 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:23.752675 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fc5dac56-6db3-44da-bd07-95e5f7a63893 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:23.760794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fc5dac56-6db3-44da-bd07-95e5f7a63893 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:23.762282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fc5dac56-6db3-44da-bd07-95e5f7a63893 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:23.763388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fc5dac56-6db3-44da-bd07-95e5f7a63893 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082341 Jul 28 03:48:23.763961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 554/958] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:23 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:24.698447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0d0cc7ca-d2f9-455f-b4fb-83a5772cc6f4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:24.699115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0d0cc7ca-d2f9-455f-b4fb-83a5772cc6f4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:24.704949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d0cc7ca-d2f9-455f-b4fb-83a5772cc6f4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:24.705387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d0cc7ca-d2f9-455f-b4fb-83a5772cc6f4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:24.706141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d0cc7ca-d2f9-455f-b4fb-83a5772cc6f4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:24.706570 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d0cc7ca-d2f9-455f-b4fb-83a5772cc6f4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:24.831748 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0d0cc7ca-d2f9-455f-b4fb-83a5772cc6f4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:24.839780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0d0cc7ca-d2f9-455f-b4fb-83a5772cc6f4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.145030 Jul 28 03:48:24.840344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 555/959] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:24 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:24.844602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-641750da-d758-4040-a435-745128b8596f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:24.845195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-641750da-d758-4040-a435-745128b8596f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:24.851052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-641750da-d758-4040-a435-745128b8596f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:24.851493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-641750da-d758-4040-a435-745128b8596f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:24.852275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-641750da-d758-4040-a435-745128b8596f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:24.852704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-641750da-d758-4040-a435-745128b8596f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:24.921595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-641750da-d758-4040-a435-745128b8596f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:24.930605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-641750da-d758-4040-a435-745128b8596f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:24.932140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-641750da-d758-4040-a435-745128b8596f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:24.933255 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-641750da-d758-4040-a435-745128b8596f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.091995 Jul 28 03:48:24.933802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 556/960] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:24 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:25.858185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-66466c41-7b9e-4fda-8591-e23da7a1ff79 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:25.858863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-66466c41-7b9e-4fda-8591-e23da7a1ff79 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:25.864822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-66466c41-7b9e-4fda-8591-e23da7a1ff79 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:25.865271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-66466c41-7b9e-4fda-8591-e23da7a1ff79 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:25.866044 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-66466c41-7b9e-4fda-8591-e23da7a1ff79 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:25.866474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-66466c41-7b9e-4fda-8591-e23da7a1ff79 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:25.987444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-66466c41-7b9e-4fda-8591-e23da7a1ff79 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:25.995179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-66466c41-7b9e-4fda-8591-e23da7a1ff79 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.140685 Jul 28 03:48:25.995766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 557/961] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:25 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:25.999984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-16f299af-c55e-480b-9e2b-c9a4b6322c9b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:26.000589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-16f299af-c55e-480b-9e2b-c9a4b6322c9b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:26.005965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16f299af-c55e-480b-9e2b-c9a4b6322c9b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:26.006415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16f299af-c55e-480b-9e2b-c9a4b6322c9b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:26.007213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16f299af-c55e-480b-9e2b-c9a4b6322c9b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:26.007650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16f299af-c55e-480b-9e2b-c9a4b6322c9b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:26.067127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-16f299af-c55e-480b-9e2b-c9a4b6322c9b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:26.075198 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-16f299af-c55e-480b-9e2b-c9a4b6322c9b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:26.076718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-16f299af-c55e-480b-9e2b-c9a4b6322c9b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:26.077824 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-16f299af-c55e-480b-9e2b-c9a4b6322c9b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081141 Jul 28 03:48:26.078370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 558/962] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:25 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:27.012122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-82257cda-bedd-4be6-ba3c-0b43507ab36a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:27.012782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-82257cda-bedd-4be6-ba3c-0b43507ab36a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:27.018497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82257cda-bedd-4be6-ba3c-0b43507ab36a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:27.018938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82257cda-bedd-4be6-ba3c-0b43507ab36a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:27.020723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82257cda-bedd-4be6-ba3c-0b43507ab36a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:27.021168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82257cda-bedd-4be6-ba3c-0b43507ab36a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:27.144674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-82257cda-bedd-4be6-ba3c-0b43507ab36a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:27.151858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-82257cda-bedd-4be6-ba3c-0b43507ab36a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.143325 Jul 28 03:48:27.152405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 559/963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:27 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:27.156547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-de9655ad-385b-415b-a498-2ab399ece729 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:27.157142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-de9655ad-385b-415b-a498-2ab399ece729 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:27.166680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de9655ad-385b-415b-a498-2ab399ece729 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:27.166680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de9655ad-385b-415b-a498-2ab399ece729 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:27.166680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de9655ad-385b-415b-a498-2ab399ece729 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:27.166680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-de9655ad-385b-415b-a498-2ab399ece729 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:27.225482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-de9655ad-385b-415b-a498-2ab399ece729 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:27.233486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-de9655ad-385b-415b-a498-2ab399ece729 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:27.234955 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-de9655ad-385b-415b-a498-2ab399ece729 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:27.236076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-de9655ad-385b-415b-a498-2ab399ece729 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082738 Jul 28 03:48:27.236623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 560/964] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:27 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:28.170447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5f89280a-ec68-46ae-87d9-a4116abc46a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:28.171013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5f89280a-ec68-46ae-87d9-a4116abc46a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:28.177355 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5f89280a-ec68-46ae-87d9-a4116abc46a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:28.177795 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5f89280a-ec68-46ae-87d9-a4116abc46a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:28.178549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5f89280a-ec68-46ae-87d9-a4116abc46a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:28.178976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5f89280a-ec68-46ae-87d9-a4116abc46a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:28.296550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5f89280a-ec68-46ae-87d9-a4116abc46a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:28.304370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5f89280a-ec68-46ae-87d9-a4116abc46a2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.137711 Jul 28 03:48:28.304922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 561/965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:28 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:28.309214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5cb445f1-c815-46a0-b617-cf585f0b593e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:28.309806 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5cb445f1-c815-46a0-b617-cf585f0b593e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:28.315093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5cb445f1-c815-46a0-b617-cf585f0b593e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:28.315532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5cb445f1-c815-46a0-b617-cf585f0b593e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:28.316322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5cb445f1-c815-46a0-b617-cf585f0b593e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:28.316917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5cb445f1-c815-46a0-b617-cf585f0b593e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:28.375700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5cb445f1-c815-46a0-b617-cf585f0b593e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:28.383739 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5cb445f1-c815-46a0-b617-cf585f0b593e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:28.385231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5cb445f1-c815-46a0-b617-cf585f0b593e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:28.386334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5cb445f1-c815-46a0-b617-cf585f0b593e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080508 Jul 28 03:48:28.386887 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 562/966] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:28 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:29.322163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ace035ea-301c-4579-b15b-87f6b781ce93 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:29.322764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ace035ea-301c-4579-b15b-87f6b781ce93 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:29.328519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ace035ea-301c-4579-b15b-87f6b781ce93 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:29.328965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ace035ea-301c-4579-b15b-87f6b781ce93 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:29.330366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ace035ea-301c-4579-b15b-87f6b781ce93 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:29.330811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ace035ea-301c-4579-b15b-87f6b781ce93 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:29.455486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ace035ea-301c-4579-b15b-87f6b781ce93 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:29.463326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ace035ea-301c-4579-b15b-87f6b781ce93 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1563 microversion: 2.1 time: 0.145202 Jul 28 03:48:29.464070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 563/967] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:29 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1563 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:29.468414 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-807c4e89-549c-406d-949d-4bbd45755323 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:29.469022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-807c4e89-549c-406d-949d-4bbd45755323 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:29.474838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-807c4e89-549c-406d-949d-4bbd45755323 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:29.475279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-807c4e89-549c-406d-949d-4bbd45755323 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:29.476060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-807c4e89-549c-406d-949d-4bbd45755323 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:29.476490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-807c4e89-549c-406d-949d-4bbd45755323 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:29.536954 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-807c4e89-549c-406d-949d-4bbd45755323 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:29.545256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-807c4e89-549c-406d-949d-4bbd45755323 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:29.546737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-807c4e89-549c-406d-949d-4bbd45755323 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:29.547884 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-807c4e89-549c-406d-949d-4bbd45755323 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082866 Jul 28 03:48:29.548434 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 564/968] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:29 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:30.338514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9eff5bed-5070-4873-9381-8dd108c15a74 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:30.339128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9eff5bed-5070-4873-9381-8dd108c15a74 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:30.344964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9eff5bed-5070-4873-9381-8dd108c15a74 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:30.345413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9eff5bed-5070-4873-9381-8dd108c15a74 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:30.346181 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9eff5bed-5070-4873-9381-8dd108c15a74 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:30.346623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9eff5bed-5070-4873-9381-8dd108c15a74 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:30.371691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9eff5bed-5070-4873-9381-8dd108c15a74 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:48:30.454362 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9eff5bed-5070-4873-9381-8dd108c15a74 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 204 len: 0 microversion: 2.1 time: 0.119261 Jul 28 03:48:30.455144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 565/969] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:48:30 2021] DELETE /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:48:30.513022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-f8d063c9-0a79-4ac9-8fd1-c8933be08d46 req-1d62c549-2f04-44d8-a8b3-ecf75501706e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e", "tag": "fbcce620-dcf6-4f36-b99e-42b820797a20"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:30.514534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:48:30.514534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:48:30.521915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-f8d063c9-0a79-4ac9-8fd1-c8933be08d46 req-1d62c549-2f04-44d8-a8b3-ecf75501706e service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:30.522360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-f8d063c9-0a79-4ac9-8fd1-c8933be08d46 req-1d62c549-2f04-44d8-a8b3-ecf75501706e service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:30.532951 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-f8d063c9-0a79-4ac9-8fd1-c8933be08d46 req-1d62c549-2f04-44d8-a8b3-ecf75501706e service nova] Creating event network-changed:fbcce620-dcf6-4f36-b99e-42b820797a20 for instance cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e on hv-cinder-73306 Jul 28 03:48:30.538263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-f8d063c9-0a79-4ac9-8fd1-c8933be08d46 req-1d62c549-2f04-44d8-a8b3-ecf75501706e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081830 Jul 28 03:48:30.538848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 566/970] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:48:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:30.543665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8a0be2f5-adca-42f6-9fc2-575b47dc26bf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:30.544386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8a0be2f5-adca-42f6-9fc2-575b47dc26bf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:30.550217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a0be2f5-adca-42f6-9fc2-575b47dc26bf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:30.550673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a0be2f5-adca-42f6-9fc2-575b47dc26bf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:30.551473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a0be2f5-adca-42f6-9fc2-575b47dc26bf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:30.552014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a0be2f5-adca-42f6-9fc2-575b47dc26bf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:30.757323 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8a0be2f5-adca-42f6-9fc2-575b47dc26bf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:30.766078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8a0be2f5-adca-42f6-9fc2-575b47dc26bf tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1569 microversion: 2.1 time: 0.225959 Jul 28 03:48:30.778464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 567/971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:30 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:30.783688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d40753ce-f4fd-4a06-9c47-42dafef3c763 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:30.784457 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d40753ce-f4fd-4a06-9c47-42dafef3c763 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:30.794226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d40753ce-f4fd-4a06-9c47-42dafef3c763 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:30.794758 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d40753ce-f4fd-4a06-9c47-42dafef3c763 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:30.795609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d40753ce-f4fd-4a06-9c47-42dafef3c763 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:30.796149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d40753ce-f4fd-4a06-9c47-42dafef3c763 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:30.883368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d40753ce-f4fd-4a06-9c47-42dafef3c763 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:30.900721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d40753ce-f4fd-4a06-9c47-42dafef3c763 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:30.903213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d40753ce-f4fd-4a06-9c47-42dafef3c763 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:30.906394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d40753ce-f4fd-4a06-9c47-42dafef3c763 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.126324 Jul 28 03:48:30.907527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 568/972] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:30 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:31.784647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d62947ce-b46f-448e-b741-8fb0b548f657 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:31.785845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d62947ce-b46f-448e-b741-8fb0b548f657 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:31.791861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d62947ce-b46f-448e-b741-8fb0b548f657 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:31.792312 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d62947ce-b46f-448e-b741-8fb0b548f657 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:31.793083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d62947ce-b46f-448e-b741-8fb0b548f657 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:31.793513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d62947ce-b46f-448e-b741-8fb0b548f657 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:31.856243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d62947ce-b46f-448e-b741-8fb0b548f657 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:31.863825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d62947ce-b46f-448e-b741-8fb0b548f657 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.082733 Jul 28 03:48:31.864500 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 569/973] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:31 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:31.924313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dbd5f36e-f22a-47a3-92d8-a732c6ff4af7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:31.925030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dbd5f36e-f22a-47a3-92d8-a732c6ff4af7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:31.930778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbd5f36e-f22a-47a3-92d8-a732c6ff4af7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:31.931247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbd5f36e-f22a-47a3-92d8-a732c6ff4af7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:31.932020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbd5f36e-f22a-47a3-92d8-a732c6ff4af7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:31.932452 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbd5f36e-f22a-47a3-92d8-a732c6ff4af7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:31.995105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dbd5f36e-f22a-47a3-92d8-a732c6ff4af7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:32.003270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dbd5f36e-f22a-47a3-92d8-a732c6ff4af7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:32.004806 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dbd5f36e-f22a-47a3-92d8-a732c6ff4af7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:32.005922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dbd5f36e-f22a-47a3-92d8-a732c6ff4af7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.085265 Jul 28 03:48:32.006477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 570/974] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:31 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:32.553029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-522f4c4d-229c-4b46-a4db-b491a8e2e9b3 req-6e7e3710-e285-4f5c-b83b-cc8668b918ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e", "name": "network-vif-deleted", "tag": "fbcce620-dcf6-4f36-b99e-42b820797a20"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:32.554493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:48:32.554493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:48:32.561140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-522f4c4d-229c-4b46-a4db-b491a8e2e9b3 req-6e7e3710-e285-4f5c-b83b-cc8668b918ba service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:32.561577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-522f4c4d-229c-4b46-a4db-b491a8e2e9b3 req-6e7e3710-e285-4f5c-b83b-cc8668b918ba service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:32.572478 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-522f4c4d-229c-4b46-a4db-b491a8e2e9b3 req-6e7e3710-e285-4f5c-b83b-cc8668b918ba service nova] Creating event network-vif-deleted:fbcce620-dcf6-4f36-b99e-42b820797a20 for instance cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e on hv-cinder-73306 Jul 28 03:48:32.577163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-522f4c4d-229c-4b46-a4db-b491a8e2e9b3 req-6e7e3710-e285-4f5c-b83b-cc8668b918ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028245 Jul 28 03:48:32.577711 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 571/975] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:48:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:48:32.881364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8f8b8add-2757-429e-8a11-f9a683f61cff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:32.882096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8f8b8add-2757-429e-8a11-f9a683f61cff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:32.888055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f8b8add-2757-429e-8a11-f9a683f61cff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:32.888506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f8b8add-2757-429e-8a11-f9a683f61cff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:32.889262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f8b8add-2757-429e-8a11-f9a683f61cff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:32.889692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f8b8add-2757-429e-8a11-f9a683f61cff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:32.948931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8f8b8add-2757-429e-8a11-f9a683f61cff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:32.956056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8f8b8add-2757-429e-8a11-f9a683f61cff tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078888 Jul 28 03:48:32.956609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 572/976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:32 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:33.023275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9857fb04-348e-4146-9499-fd5ec92d753e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:33.023907 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9857fb04-348e-4146-9499-fd5ec92d753e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:33.029513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9857fb04-348e-4146-9499-fd5ec92d753e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:33.029964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9857fb04-348e-4146-9499-fd5ec92d753e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:33.030723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9857fb04-348e-4146-9499-fd5ec92d753e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:33.031165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9857fb04-348e-4146-9499-fd5ec92d753e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:33.089064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9857fb04-348e-4146-9499-fd5ec92d753e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:33.096981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9857fb04-348e-4146-9499-fd5ec92d753e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:33.099337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9857fb04-348e-4146-9499-fd5ec92d753e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:33.100466 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9857fb04-348e-4146-9499-fd5ec92d753e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080952 Jul 28 03:48:33.101017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 573/977] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:33 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:33.973368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-652c9817-2467-42e7-88b2-2d613b16c76e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:33.974243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-652c9817-2467-42e7-88b2-2d613b16c76e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:33.979988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-652c9817-2467-42e7-88b2-2d613b16c76e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:33.980437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-652c9817-2467-42e7-88b2-2d613b16c76e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:33.981202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-652c9817-2467-42e7-88b2-2d613b16c76e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:33.981635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-652c9817-2467-42e7-88b2-2d613b16c76e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:34.039642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-652c9817-2467-42e7-88b2-2d613b16c76e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:34.046768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-652c9817-2467-42e7-88b2-2d613b16c76e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077096 Jul 28 03:48:34.047340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 574/978] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:33 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:34.117630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5a93d495-8089-4492-8356-82e6d97f6cd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:34.118243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5a93d495-8089-4492-8356-82e6d97f6cd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:34.124180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a93d495-8089-4492-8356-82e6d97f6cd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:34.124513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a93d495-8089-4492-8356-82e6d97f6cd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:34.125279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a93d495-8089-4492-8356-82e6d97f6cd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:34.125708 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a93d495-8089-4492-8356-82e6d97f6cd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:34.185094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5a93d495-8089-4492-8356-82e6d97f6cd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:34.194005 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5a93d495-8089-4492-8356-82e6d97f6cd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:34.195485 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5a93d495-8089-4492-8356-82e6d97f6cd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:34.196638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5a93d495-8089-4492-8356-82e6d97f6cd0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.083203 Jul 28 03:48:34.197184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 575/979] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:34 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:35.064206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-09f45ac8-b586-48be-bf6e-0360425d8817 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:35.064842 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-09f45ac8-b586-48be-bf6e-0360425d8817 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:35.071064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-09f45ac8-b586-48be-bf6e-0360425d8817 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:35.071505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-09f45ac8-b586-48be-bf6e-0360425d8817 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:35.072293 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-09f45ac8-b586-48be-bf6e-0360425d8817 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:35.072724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-09f45ac8-b586-48be-bf6e-0360425d8817 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:35.131770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-09f45ac8-b586-48be-bf6e-0360425d8817 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:35.138957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-09f45ac8-b586-48be-bf6e-0360425d8817 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078703 Jul 28 03:48:35.139503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 576/980] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:35 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:35.213750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d51f6010-0379-4740-bb66-055650a2cf7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:35.214348 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d51f6010-0379-4740-bb66-055650a2cf7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:35.220025 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d51f6010-0379-4740-bb66-055650a2cf7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:35.220470 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d51f6010-0379-4740-bb66-055650a2cf7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:35.221218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d51f6010-0379-4740-bb66-055650a2cf7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:35.221643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d51f6010-0379-4740-bb66-055650a2cf7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:35.283653 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d51f6010-0379-4740-bb66-055650a2cf7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:35.291999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d51f6010-0379-4740-bb66-055650a2cf7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:35.293467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d51f6010-0379-4740-bb66-055650a2cf7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:35.294560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d51f6010-0379-4740-bb66-055650a2cf7b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084404 Jul 28 03:48:35.295118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 577/981] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:35 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:36.155123 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-28f3e941-06e7-4e6a-9190-bb51f4d7788f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:36.155669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-28f3e941-06e7-4e6a-9190-bb51f4d7788f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:36.162049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28f3e941-06e7-4e6a-9190-bb51f4d7788f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:36.162526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28f3e941-06e7-4e6a-9190-bb51f4d7788f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:36.163289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28f3e941-06e7-4e6a-9190-bb51f4d7788f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:36.163731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28f3e941-06e7-4e6a-9190-bb51f4d7788f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:36.223015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-28f3e941-06e7-4e6a-9190-bb51f4d7788f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:36.230464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-28f3e941-06e7-4e6a-9190-bb51f4d7788f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078894 Jul 28 03:48:36.231019 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 578/982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:36 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:36.312160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a4082fcd-0e8e-4b72-bca0-8e5b3787089a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:36.312756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a4082fcd-0e8e-4b72-bca0-8e5b3787089a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:36.318913 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4082fcd-0e8e-4b72-bca0-8e5b3787089a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:36.319361 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4082fcd-0e8e-4b72-bca0-8e5b3787089a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:36.320153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4082fcd-0e8e-4b72-bca0-8e5b3787089a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:36.320586 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4082fcd-0e8e-4b72-bca0-8e5b3787089a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:36.380602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4082fcd-0e8e-4b72-bca0-8e5b3787089a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:36.388577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4082fcd-0e8e-4b72-bca0-8e5b3787089a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:36.390060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4082fcd-0e8e-4b72-bca0-8e5b3787089a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:36.391170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a4082fcd-0e8e-4b72-bca0-8e5b3787089a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082393 Jul 28 03:48:36.391713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 579/983] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:36 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:37.248144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5c179fde-f42b-4ff7-a37b-69914f2c1067 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:37.248784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5c179fde-f42b-4ff7-a37b-69914f2c1067 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:37.254551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c179fde-f42b-4ff7-a37b-69914f2c1067 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:37.254991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c179fde-f42b-4ff7-a37b-69914f2c1067 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:37.255777 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c179fde-f42b-4ff7-a37b-69914f2c1067 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:37.256211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c179fde-f42b-4ff7-a37b-69914f2c1067 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:37.314718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5c179fde-f42b-4ff7-a37b-69914f2c1067 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:37.322530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5c179fde-f42b-4ff7-a37b-69914f2c1067 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078002 Jul 28 03:48:37.323084 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 580/984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:37 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:37.408769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-88f6ab1b-6ac5-40de-bd37-b7b5d157dcbf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:37.409303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-88f6ab1b-6ac5-40de-bd37-b7b5d157dcbf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:37.415068 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88f6ab1b-6ac5-40de-bd37-b7b5d157dcbf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:37.415512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88f6ab1b-6ac5-40de-bd37-b7b5d157dcbf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:37.416302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88f6ab1b-6ac5-40de-bd37-b7b5d157dcbf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:37.416736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88f6ab1b-6ac5-40de-bd37-b7b5d157dcbf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:37.475450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-88f6ab1b-6ac5-40de-bd37-b7b5d157dcbf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:37.483453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-88f6ab1b-6ac5-40de-bd37-b7b5d157dcbf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:37.484978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-88f6ab1b-6ac5-40de-bd37-b7b5d157dcbf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:37.486096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-88f6ab1b-6ac5-40de-bd37-b7b5d157dcbf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080873 Jul 28 03:48:37.486657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 581/985] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:37 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:38.340250 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b6b15aa5-0fdc-43ab-a640-b03bef1c79d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:38.340876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b6b15aa5-0fdc-43ab-a640-b03bef1c79d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:38.346691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6b15aa5-0fdc-43ab-a640-b03bef1c79d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:38.347136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6b15aa5-0fdc-43ab-a640-b03bef1c79d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:38.348428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6b15aa5-0fdc-43ab-a640-b03bef1c79d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:38.349179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6b15aa5-0fdc-43ab-a640-b03bef1c79d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:38.407190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b6b15aa5-0fdc-43ab-a640-b03bef1c79d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:38.415188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b6b15aa5-0fdc-43ab-a640-b03bef1c79d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078585 Jul 28 03:48:38.415763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 582/986] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:38 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:38.503459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-41c2ba96-82ac-47de-9164-5c37acdb4a43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:38.504507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-41c2ba96-82ac-47de-9164-5c37acdb4a43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:38.510140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41c2ba96-82ac-47de-9164-5c37acdb4a43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:38.510581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41c2ba96-82ac-47de-9164-5c37acdb4a43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:38.511334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41c2ba96-82ac-47de-9164-5c37acdb4a43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:38.511787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41c2ba96-82ac-47de-9164-5c37acdb4a43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:38.573682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-41c2ba96-82ac-47de-9164-5c37acdb4a43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:38.581698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-41c2ba96-82ac-47de-9164-5c37acdb4a43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:38.583670 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-41c2ba96-82ac-47de-9164-5c37acdb4a43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:38.584802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-41c2ba96-82ac-47de-9164-5c37acdb4a43 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084792 Jul 28 03:48:38.585352 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 583/987] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:38 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:39.431435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-31db21cb-56a1-42d3-9f87-6be46e0ee514 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:39.432097 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-31db21cb-56a1-42d3-9f87-6be46e0ee514 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:39.437875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-31db21cb-56a1-42d3-9f87-6be46e0ee514 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:39.438327 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-31db21cb-56a1-42d3-9f87-6be46e0ee514 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:39.439093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-31db21cb-56a1-42d3-9f87-6be46e0ee514 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:39.439532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-31db21cb-56a1-42d3-9f87-6be46e0ee514 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:39.498296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-31db21cb-56a1-42d3-9f87-6be46e0ee514 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:39.505875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-31db21cb-56a1-42d3-9f87-6be46e0ee514 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078170 Jul 28 03:48:39.506435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 584/988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:39 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:39.602292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-02950a5c-c13d-48ef-80ac-81ad13e2df16 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:39.602971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-02950a5c-c13d-48ef-80ac-81ad13e2df16 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:39.608731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-02950a5c-c13d-48ef-80ac-81ad13e2df16 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:39.609156 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-02950a5c-c13d-48ef-80ac-81ad13e2df16 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:39.609910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-02950a5c-c13d-48ef-80ac-81ad13e2df16 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:39.610336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-02950a5c-c13d-48ef-80ac-81ad13e2df16 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:39.668891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-02950a5c-c13d-48ef-80ac-81ad13e2df16 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:39.677056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-02950a5c-c13d-48ef-80ac-81ad13e2df16 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:39.678545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-02950a5c-c13d-48ef-80ac-81ad13e2df16 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:39.679649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-02950a5c-c13d-48ef-80ac-81ad13e2df16 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081151 Jul 28 03:48:39.680225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 585/989] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:39 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:40.522445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cac00be9-c6a0-443d-befe-6b48a80e4427 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:40.523099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cac00be9-c6a0-443d-befe-6b48a80e4427 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:40.528986 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cac00be9-c6a0-443d-befe-6b48a80e4427 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:40.529436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cac00be9-c6a0-443d-befe-6b48a80e4427 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:40.530201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cac00be9-c6a0-443d-befe-6b48a80e4427 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:40.530639 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cac00be9-c6a0-443d-befe-6b48a80e4427 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:40.588915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cac00be9-c6a0-443d-befe-6b48a80e4427 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:40.596032 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cac00be9-c6a0-443d-befe-6b48a80e4427 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077273 Jul 28 03:48:40.596588 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 586/990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:40 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:40.697036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1ad85a8c-e5c5-40e6-9d31-3123b7fd6946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:40.697637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1ad85a8c-e5c5-40e6-9d31-3123b7fd6946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:40.703166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ad85a8c-e5c5-40e6-9d31-3123b7fd6946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:40.703613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ad85a8c-e5c5-40e6-9d31-3123b7fd6946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:40.704406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ad85a8c-e5c5-40e6-9d31-3123b7fd6946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:40.704840 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ad85a8c-e5c5-40e6-9d31-3123b7fd6946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:40.763317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1ad85a8c-e5c5-40e6-9d31-3123b7fd6946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:40.771902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1ad85a8c-e5c5-40e6-9d31-3123b7fd6946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:40.773432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1ad85a8c-e5c5-40e6-9d31-3123b7fd6946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:40.774491 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1ad85a8c-e5c5-40e6-9d31-3123b7fd6946 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080901 Jul 28 03:48:40.775036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 587/991] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:40 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:41.614242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bcaaa37f-175a-4c1a-9dd9-9c2aa02b4367 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:41.614884 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bcaaa37f-175a-4c1a-9dd9-9c2aa02b4367 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:41.620694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bcaaa37f-175a-4c1a-9dd9-9c2aa02b4367 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:41.621116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bcaaa37f-175a-4c1a-9dd9-9c2aa02b4367 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:41.621873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bcaaa37f-175a-4c1a-9dd9-9c2aa02b4367 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:41.622302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bcaaa37f-175a-4c1a-9dd9-9c2aa02b4367 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:41.680295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bcaaa37f-175a-4c1a-9dd9-9c2aa02b4367 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:41.687348 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bcaaa37f-175a-4c1a-9dd9-9c2aa02b4367 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077362 Jul 28 03:48:41.687923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 588/992] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:41 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:41.791633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-64d678f4-18b7-475a-bda8-b20dbeee1cee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:41.792263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-64d678f4-18b7-475a-bda8-b20dbeee1cee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:41.797834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-64d678f4-18b7-475a-bda8-b20dbeee1cee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:41.798284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-64d678f4-18b7-475a-bda8-b20dbeee1cee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:41.799043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-64d678f4-18b7-475a-bda8-b20dbeee1cee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:41.799476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-64d678f4-18b7-475a-bda8-b20dbeee1cee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:41.861534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-64d678f4-18b7-475a-bda8-b20dbeee1cee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:41.870281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-64d678f4-18b7-475a-bda8-b20dbeee1cee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:41.871701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-64d678f4-18b7-475a-bda8-b20dbeee1cee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:41.872837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-64d678f4-18b7-475a-bda8-b20dbeee1cee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084745 Jul 28 03:48:41.873380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 589/993] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:41 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:42.704618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-07818482-906a-45d7-b27c-ecfc8bc8030b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:42.705271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-07818482-906a-45d7-b27c-ecfc8bc8030b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:42.711837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07818482-906a-45d7-b27c-ecfc8bc8030b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:42.712283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07818482-906a-45d7-b27c-ecfc8bc8030b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:42.713041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07818482-906a-45d7-b27c-ecfc8bc8030b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:42.713470 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07818482-906a-45d7-b27c-ecfc8bc8030b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:42.772196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-07818482-906a-45d7-b27c-ecfc8bc8030b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:42.779276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-07818482-906a-45d7-b27c-ecfc8bc8030b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078279 Jul 28 03:48:42.779859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 590/994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:42 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:42.889924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6b226510-5769-432e-b9bb-748edf13101c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:42.890524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6b226510-5769-432e-b9bb-748edf13101c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:42.896816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b226510-5769-432e-b9bb-748edf13101c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:42.897261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b226510-5769-432e-b9bb-748edf13101c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:42.898017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b226510-5769-432e-b9bb-748edf13101c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:42.898447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6b226510-5769-432e-b9bb-748edf13101c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:42.957071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6b226510-5769-432e-b9bb-748edf13101c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:42.965026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6b226510-5769-432e-b9bb-748edf13101c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:42.966501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6b226510-5769-432e-b9bb-748edf13101c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:42.967605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6b226510-5769-432e-b9bb-748edf13101c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081100 Jul 28 03:48:42.968185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 591/995] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:42 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:43.796162 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7e22d999-8f6d-4caa-8733-560867d8b959 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:43.796847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7e22d999-8f6d-4caa-8733-560867d8b959 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:43.802644 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e22d999-8f6d-4caa-8733-560867d8b959 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:43.803085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e22d999-8f6d-4caa-8733-560867d8b959 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:43.803873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e22d999-8f6d-4caa-8733-560867d8b959 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:43.804304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e22d999-8f6d-4caa-8733-560867d8b959 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:43.862569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7e22d999-8f6d-4caa-8733-560867d8b959 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:43.870267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7e22d999-8f6d-4caa-8733-560867d8b959 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077748 Jul 28 03:48:43.870826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 592/996] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:43 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:43.985420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3975278d-0e49-4aac-8da3-e13e1864effd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:43.986013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3975278d-0e49-4aac-8da3-e13e1864effd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:43.991910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3975278d-0e49-4aac-8da3-e13e1864effd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:43.992355 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3975278d-0e49-4aac-8da3-e13e1864effd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:43.993109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3975278d-0e49-4aac-8da3-e13e1864effd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:43.993535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3975278d-0e49-4aac-8da3-e13e1864effd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:44.052041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3975278d-0e49-4aac-8da3-e13e1864effd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:44.060179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3975278d-0e49-4aac-8da3-e13e1864effd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:44.061671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3975278d-0e49-4aac-8da3-e13e1864effd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:44.062780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3975278d-0e49-4aac-8da3-e13e1864effd tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080870 Jul 28 03:48:44.063323 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 593/997] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:43 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:44.886127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f1e85c78-887c-4377-97da-a6da06841081 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:44.886743 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f1e85c78-887c-4377-97da-a6da06841081 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:44.892482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1e85c78-887c-4377-97da-a6da06841081 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:44.892927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1e85c78-887c-4377-97da-a6da06841081 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:44.893680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1e85c78-887c-4377-97da-a6da06841081 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:44.894109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1e85c78-887c-4377-97da-a6da06841081 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:44.952506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f1e85c78-887c-4377-97da-a6da06841081 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:44.960047 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f1e85c78-887c-4377-97da-a6da06841081 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077551 Jul 28 03:48:44.960597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 594/998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:44 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:45.080704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ebe75a2a-ef45-48d0-a5b1-42ab1fe7c43d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:45.081302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ebe75a2a-ef45-48d0-a5b1-42ab1fe7c43d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:45.087318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ebe75a2a-ef45-48d0-a5b1-42ab1fe7c43d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:45.087784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ebe75a2a-ef45-48d0-a5b1-42ab1fe7c43d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:45.088541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ebe75a2a-ef45-48d0-a5b1-42ab1fe7c43d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:45.088990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ebe75a2a-ef45-48d0-a5b1-42ab1fe7c43d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:45.151344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ebe75a2a-ef45-48d0-a5b1-42ab1fe7c43d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:45.159450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ebe75a2a-ef45-48d0-a5b1-42ab1fe7c43d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:45.161995 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ebe75a2a-ef45-48d0-a5b1-42ab1fe7c43d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:45.163175 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ebe75a2a-ef45-48d0-a5b1-42ab1fe7c43d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.085936 Jul 28 03:48:45.163984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 595/999] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:45 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:45.977233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-34db001c-036e-4b7d-836b-66e172e7e0c9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:45.977779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-34db001c-036e-4b7d-836b-66e172e7e0c9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:45.983518 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34db001c-036e-4b7d-836b-66e172e7e0c9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:45.983992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34db001c-036e-4b7d-836b-66e172e7e0c9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:45.984748 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34db001c-036e-4b7d-836b-66e172e7e0c9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:45.985172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34db001c-036e-4b7d-836b-66e172e7e0c9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:46.043886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-34db001c-036e-4b7d-836b-66e172e7e0c9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:46.051611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-34db001c-036e-4b7d-836b-66e172e7e0c9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078393 Jul 28 03:48:46.052183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 596/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:45 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:46.181225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2158d963-c4fb-4423-a925-7bfb6c24e123 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:46.181831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2158d963-c4fb-4423-a925-7bfb6c24e123 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:46.187650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2158d963-c4fb-4423-a925-7bfb6c24e123 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:46.188124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2158d963-c4fb-4423-a925-7bfb6c24e123 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:46.188879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2158d963-c4fb-4423-a925-7bfb6c24e123 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:46.189310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2158d963-c4fb-4423-a925-7bfb6c24e123 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:46.248265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2158d963-c4fb-4423-a925-7bfb6c24e123 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:46.256945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2158d963-c4fb-4423-a925-7bfb6c24e123 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:46.258416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2158d963-c4fb-4423-a925-7bfb6c24e123 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:46.259520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2158d963-c4fb-4423-a925-7bfb6c24e123 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081941 Jul 28 03:48:46.260107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 597/1001] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:46 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:47.068883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-41967a5a-1fcf-4760-8850-b2437ac8086b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:47.069534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-41967a5a-1fcf-4760-8850-b2437ac8086b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:47.075238 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41967a5a-1fcf-4760-8850-b2437ac8086b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:47.075686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41967a5a-1fcf-4760-8850-b2437ac8086b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:47.076480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41967a5a-1fcf-4760-8850-b2437ac8086b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:47.076917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-41967a5a-1fcf-4760-8850-b2437ac8086b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:47.135800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-41967a5a-1fcf-4760-8850-b2437ac8086b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:47.143128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-41967a5a-1fcf-4760-8850-b2437ac8086b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078482 Jul 28 03:48:47.143686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 598/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:47 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:47.277176 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8d7f818a-14d6-4262-ae27-48fe14ed9c78 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:47.277782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8d7f818a-14d6-4262-ae27-48fe14ed9c78 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:47.283536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d7f818a-14d6-4262-ae27-48fe14ed9c78 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:47.284014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d7f818a-14d6-4262-ae27-48fe14ed9c78 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:47.284828 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d7f818a-14d6-4262-ae27-48fe14ed9c78 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:47.285257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8d7f818a-14d6-4262-ae27-48fe14ed9c78 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:47.343315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d7f818a-14d6-4262-ae27-48fe14ed9c78 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:47.351603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d7f818a-14d6-4262-ae27-48fe14ed9c78 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:47.353116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8d7f818a-14d6-4262-ae27-48fe14ed9c78 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:47.354224 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8d7f818a-14d6-4262-ae27-48fe14ed9c78 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080670 Jul 28 03:48:47.354767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 599/1003] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:47 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:48.161443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bb22f496-4644-416c-8a3f-31f6e044be2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:48.162053 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bb22f496-4644-416c-8a3f-31f6e044be2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:48.167899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bb22f496-4644-416c-8a3f-31f6e044be2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:48.168347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bb22f496-4644-416c-8a3f-31f6e044be2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:48.169117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bb22f496-4644-416c-8a3f-31f6e044be2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:48.169552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bb22f496-4644-416c-8a3f-31f6e044be2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:48.228325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bb22f496-4644-416c-8a3f-31f6e044be2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:48.235366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bb22f496-4644-416c-8a3f-31f6e044be2f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078460 Jul 28 03:48:48.235961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 600/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:48 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:48.371126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-87ea8476-cbd5-4ca7-b352-a248f1a7f6a9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:48.371745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-87ea8476-cbd5-4ca7-b352-a248f1a7f6a9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:48.377339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87ea8476-cbd5-4ca7-b352-a248f1a7f6a9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:48.377784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87ea8476-cbd5-4ca7-b352-a248f1a7f6a9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:48.378603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87ea8476-cbd5-4ca7-b352-a248f1a7f6a9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:48.379072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87ea8476-cbd5-4ca7-b352-a248f1a7f6a9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:48.440152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-87ea8476-cbd5-4ca7-b352-a248f1a7f6a9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:48.448182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-87ea8476-cbd5-4ca7-b352-a248f1a7f6a9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:48.449669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-87ea8476-cbd5-4ca7-b352-a248f1a7f6a9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:48.450775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-87ea8476-cbd5-4ca7-b352-a248f1a7f6a9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.083150 Jul 28 03:48:48.451331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 601/1005] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:48 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:49.252381 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-864a65fa-aba4-4ef8-a909-249639066112 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:49.253021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-864a65fa-aba4-4ef8-a909-249639066112 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:49.259441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-864a65fa-aba4-4ef8-a909-249639066112 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:49.259919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-864a65fa-aba4-4ef8-a909-249639066112 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:49.260679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-864a65fa-aba4-4ef8-a909-249639066112 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:49.261107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-864a65fa-aba4-4ef8-a909-249639066112 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:49.318738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-864a65fa-aba4-4ef8-a909-249639066112 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:49.325956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-864a65fa-aba4-4ef8-a909-249639066112 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077244 Jul 28 03:48:49.326492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 602/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:49 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:49.469426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-32bae16d-81b6-44f9-9c98-a1cc9419da7a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:49.469958 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-32bae16d-81b6-44f9-9c98-a1cc9419da7a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:49.476533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32bae16d-81b6-44f9-9c98-a1cc9419da7a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:49.476984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32bae16d-81b6-44f9-9c98-a1cc9419da7a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:49.477755 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32bae16d-81b6-44f9-9c98-a1cc9419da7a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:49.478192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32bae16d-81b6-44f9-9c98-a1cc9419da7a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:49.537018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-32bae16d-81b6-44f9-9c98-a1cc9419da7a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:49.545094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-32bae16d-81b6-44f9-9c98-a1cc9419da7a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:49.546580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-32bae16d-81b6-44f9-9c98-a1cc9419da7a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:49.547686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-32bae16d-81b6-44f9-9c98-a1cc9419da7a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082370 Jul 28 03:48:49.548261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 603/1007] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:49 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:50.342654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fa9db7f7-f553-431b-b0f2-4244b5e6db2e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:50.343291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fa9db7f7-f553-431b-b0f2-4244b5e6db2e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:50.349568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa9db7f7-f553-431b-b0f2-4244b5e6db2e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:50.350006 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa9db7f7-f553-431b-b0f2-4244b5e6db2e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:50.350762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa9db7f7-f553-431b-b0f2-4244b5e6db2e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:50.351185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa9db7f7-f553-431b-b0f2-4244b5e6db2e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:50.409253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fa9db7f7-f553-431b-b0f2-4244b5e6db2e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:50.416483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fa9db7f7-f553-431b-b0f2-4244b5e6db2e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077515 Jul 28 03:48:50.417032 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 604/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:50 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:50.566998 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b2fc2a86-cd0e-4e75-ae77-f7af7c9e3258 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:50.567631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b2fc2a86-cd0e-4e75-ae77-f7af7c9e3258 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:50.573401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2fc2a86-cd0e-4e75-ae77-f7af7c9e3258 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:50.573852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2fc2a86-cd0e-4e75-ae77-f7af7c9e3258 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:50.574615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2fc2a86-cd0e-4e75-ae77-f7af7c9e3258 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:50.575049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2fc2a86-cd0e-4e75-ae77-f7af7c9e3258 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:50.633947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b2fc2a86-cd0e-4e75-ae77-f7af7c9e3258 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:50.642172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b2fc2a86-cd0e-4e75-ae77-f7af7c9e3258 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:50.643657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b2fc2a86-cd0e-4e75-ae77-f7af7c9e3258 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:50.644794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b2fc2a86-cd0e-4e75-ae77-f7af7c9e3258 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082118 Jul 28 03:48:50.645335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 605/1009] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:50 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:51.433737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6fbbd685-1e58-4353-abf5-1b984f0cfdab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:51.434423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6fbbd685-1e58-4353-abf5-1b984f0cfdab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:51.440136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6fbbd685-1e58-4353-abf5-1b984f0cfdab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:51.440580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6fbbd685-1e58-4353-abf5-1b984f0cfdab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:51.441445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6fbbd685-1e58-4353-abf5-1b984f0cfdab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:51.441873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6fbbd685-1e58-4353-abf5-1b984f0cfdab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:51.500208 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6fbbd685-1e58-4353-abf5-1b984f0cfdab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:51.507415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6fbbd685-1e58-4353-abf5-1b984f0cfdab tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077343 Jul 28 03:48:51.507992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 606/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:51 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:51.662442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8b26bce8-0df9-4bed-9f36-f627472a16d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:51.663041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8b26bce8-0df9-4bed-9f36-f627472a16d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:51.668673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8b26bce8-0df9-4bed-9f36-f627472a16d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:51.669116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8b26bce8-0df9-4bed-9f36-f627472a16d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:51.669869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8b26bce8-0df9-4bed-9f36-f627472a16d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:51.670296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8b26bce8-0df9-4bed-9f36-f627472a16d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:51.732285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8b26bce8-0df9-4bed-9f36-f627472a16d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:51.740733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8b26bce8-0df9-4bed-9f36-f627472a16d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:51.742229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8b26bce8-0df9-4bed-9f36-f627472a16d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:51.743340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8b26bce8-0df9-4bed-9f36-f627472a16d7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084776 Jul 28 03:48:51.743915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 607/1011] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:51 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:52.524073 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2ce0a5ec-b2e2-4fb0-aa76-0b1cfa17e6ac tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:52.524705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2ce0a5ec-b2e2-4fb0-aa76-0b1cfa17e6ac tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:52.530377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ce0a5ec-b2e2-4fb0-aa76-0b1cfa17e6ac tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:52.530818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ce0a5ec-b2e2-4fb0-aa76-0b1cfa17e6ac tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:52.531572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ce0a5ec-b2e2-4fb0-aa76-0b1cfa17e6ac tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:52.532023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ce0a5ec-b2e2-4fb0-aa76-0b1cfa17e6ac tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:52.590771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2ce0a5ec-b2e2-4fb0-aa76-0b1cfa17e6ac tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:52.598414 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2ce0a5ec-b2e2-4fb0-aa76-0b1cfa17e6ac tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078076 Jul 28 03:48:52.599222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 608/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:52 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:52.761543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3e450214-cc2e-4a05-9dc5-d57e71513a41 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:52.762169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3e450214-cc2e-4a05-9dc5-d57e71513a41 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:52.768243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3e450214-cc2e-4a05-9dc5-d57e71513a41 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:52.768703 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3e450214-cc2e-4a05-9dc5-d57e71513a41 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:52.769962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3e450214-cc2e-4a05-9dc5-d57e71513a41 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:52.770397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3e450214-cc2e-4a05-9dc5-d57e71513a41 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:52.828764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3e450214-cc2e-4a05-9dc5-d57e71513a41 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:52.837768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3e450214-cc2e-4a05-9dc5-d57e71513a41 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:52.839260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3e450214-cc2e-4a05-9dc5-d57e71513a41 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:52.840421 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3e450214-cc2e-4a05-9dc5-d57e71513a41 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082503 Jul 28 03:48:52.840977 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 609/1013] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:52 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:53.615978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-40635f85-082e-453b-9f0d-cb20ceedcfe1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:53.616633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-40635f85-082e-453b-9f0d-cb20ceedcfe1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:53.622318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-40635f85-082e-453b-9f0d-cb20ceedcfe1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:53.622761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-40635f85-082e-453b-9f0d-cb20ceedcfe1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:53.623512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-40635f85-082e-453b-9f0d-cb20ceedcfe1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:53.623969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-40635f85-082e-453b-9f0d-cb20ceedcfe1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:53.683478 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-40635f85-082e-453b-9f0d-cb20ceedcfe1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:53.690720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-40635f85-082e-453b-9f0d-cb20ceedcfe1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079265 Jul 28 03:48:53.692080 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 610/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:53 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:53.858773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5978e582-3c25-448d-acbb-56e6b5f0ed6d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:53.859391 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5978e582-3c25-448d-acbb-56e6b5f0ed6d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:53.865694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5978e582-3c25-448d-acbb-56e6b5f0ed6d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:53.866191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5978e582-3c25-448d-acbb-56e6b5f0ed6d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:53.866898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5978e582-3c25-448d-acbb-56e6b5f0ed6d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:53.867328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5978e582-3c25-448d-acbb-56e6b5f0ed6d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:53.926394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5978e582-3c25-448d-acbb-56e6b5f0ed6d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:53.935403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5978e582-3c25-448d-acbb-56e6b5f0ed6d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:53.936917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5978e582-3c25-448d-acbb-56e6b5f0ed6d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:53.938055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5978e582-3c25-448d-acbb-56e6b5f0ed6d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082710 Jul 28 03:48:53.938601 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 611/1015] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:53 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:54.709166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6871365d-35ed-4c32-9937-fd0bb5127c35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:54.709803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6871365d-35ed-4c32-9937-fd0bb5127c35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:54.715669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6871365d-35ed-4c32-9937-fd0bb5127c35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:54.716143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6871365d-35ed-4c32-9937-fd0bb5127c35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:54.716905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6871365d-35ed-4c32-9937-fd0bb5127c35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:54.717340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6871365d-35ed-4c32-9937-fd0bb5127c35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:54.776032 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6871365d-35ed-4c32-9937-fd0bb5127c35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:54.783224 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6871365d-35ed-4c32-9937-fd0bb5127c35 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078485 Jul 28 03:48:54.783800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 612/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:54 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:54.955212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4eac1c57-2eb9-46d8-abce-eb802d7b5cb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:54.955847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4eac1c57-2eb9-46d8-abce-eb802d7b5cb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:54.961468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eac1c57-2eb9-46d8-abce-eb802d7b5cb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:54.961863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eac1c57-2eb9-46d8-abce-eb802d7b5cb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:54.962627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eac1c57-2eb9-46d8-abce-eb802d7b5cb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:54.963060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eac1c57-2eb9-46d8-abce-eb802d7b5cb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:54.994167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:48:54.994324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 03:48:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f (ip 10.222.0.16) !!! Jul 28 03:48:55.025938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4eac1c57-2eb9-46d8-abce-eb802d7b5cb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:55.034034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4eac1c57-2eb9-46d8-abce-eb802d7b5cb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:55.035771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4eac1c57-2eb9-46d8-abce-eb802d7b5cb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:55.036886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4eac1c57-2eb9-46d8-abce-eb802d7b5cb4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.085140 Jul 28 03:48:55.037436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 613/1017] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:54 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:55.799867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f42b3f75-a3fe-4f06-b7fb-64b6a6cfd57a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:55.800800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f42b3f75-a3fe-4f06-b7fb-64b6a6cfd57a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:55.806319 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f42b3f75-a3fe-4f06-b7fb-64b6a6cfd57a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:55.806770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f42b3f75-a3fe-4f06-b7fb-64b6a6cfd57a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:55.807536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f42b3f75-a3fe-4f06-b7fb-64b6a6cfd57a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:55.808000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f42b3f75-a3fe-4f06-b7fb-64b6a6cfd57a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:55.866245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f42b3f75-a3fe-4f06-b7fb-64b6a6cfd57a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:55.873424 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f42b3f75-a3fe-4f06-b7fb-64b6a6cfd57a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077192 Jul 28 03:48:55.873973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 614/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:55 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:56.054171 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cbde7729-23e3-429e-83d8-8ac879505d65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:56.054776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cbde7729-23e3-429e-83d8-8ac879505d65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:56.060503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbde7729-23e3-429e-83d8-8ac879505d65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:56.060953 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbde7729-23e3-429e-83d8-8ac879505d65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:56.061719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbde7729-23e3-429e-83d8-8ac879505d65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:56.062150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbde7729-23e3-429e-83d8-8ac879505d65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:56.121313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cbde7729-23e3-429e-83d8-8ac879505d65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:56.130252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cbde7729-23e3-429e-83d8-8ac879505d65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:56.131726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cbde7729-23e3-429e-83d8-8ac879505d65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:56.132858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cbde7729-23e3-429e-83d8-8ac879505d65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082490 Jul 28 03:48:56.133409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 615/1019] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:56 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:56.890514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-404211e0-4e74-4b68-ab7b-dcc2d52d1ba0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:56.891099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-404211e0-4e74-4b68-ab7b-dcc2d52d1ba0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:56.896933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-404211e0-4e74-4b68-ab7b-dcc2d52d1ba0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:56.897379 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-404211e0-4e74-4b68-ab7b-dcc2d52d1ba0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:56.898136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-404211e0-4e74-4b68-ab7b-dcc2d52d1ba0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:56.898567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-404211e0-4e74-4b68-ab7b-dcc2d52d1ba0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:56.956811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-404211e0-4e74-4b68-ab7b-dcc2d52d1ba0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:56.964118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-404211e0-4e74-4b68-ab7b-dcc2d52d1ba0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077382 Jul 28 03:48:56.964681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 616/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:56 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:57.150851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0a5a5fbe-b83d-48f7-bb93-c1a2b1012963 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:57.151395 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0a5a5fbe-b83d-48f7-bb93-c1a2b1012963 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:57.157099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a5a5fbe-b83d-48f7-bb93-c1a2b1012963 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:57.157548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a5a5fbe-b83d-48f7-bb93-c1a2b1012963 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:57.158297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a5a5fbe-b83d-48f7-bb93-c1a2b1012963 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:57.158724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a5a5fbe-b83d-48f7-bb93-c1a2b1012963 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:57.218066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0a5a5fbe-b83d-48f7-bb93-c1a2b1012963 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:57.226549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0a5a5fbe-b83d-48f7-bb93-c1a2b1012963 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:57.228054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0a5a5fbe-b83d-48f7-bb93-c1a2b1012963 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:57.229141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0a5a5fbe-b83d-48f7-bb93-c1a2b1012963 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082052 Jul 28 03:48:57.229682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 617/1021] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:57 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:57.981210 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9c852777-4ddb-4d09-8296-89642c9486a6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:57.981828 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9c852777-4ddb-4d09-8296-89642c9486a6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:57.987640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c852777-4ddb-4d09-8296-89642c9486a6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:57.988144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c852777-4ddb-4d09-8296-89642c9486a6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:57.988909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c852777-4ddb-4d09-8296-89642c9486a6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:57.989368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c852777-4ddb-4d09-8296-89642c9486a6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:58.048064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9c852777-4ddb-4d09-8296-89642c9486a6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:58.055254 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9c852777-4ddb-4d09-8296-89642c9486a6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077664 Jul 28 03:48:58.055838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 618/1022] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:57 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:58.247326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e364a812-32ef-4232-a393-85b7b9d3c847 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:58.247902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e364a812-32ef-4232-a393-85b7b9d3c847 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:58.253682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e364a812-32ef-4232-a393-85b7b9d3c847 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:58.254129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e364a812-32ef-4232-a393-85b7b9d3c847 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:58.254892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e364a812-32ef-4232-a393-85b7b9d3c847 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:58.255328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e364a812-32ef-4232-a393-85b7b9d3c847 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:58.317697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e364a812-32ef-4232-a393-85b7b9d3c847 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:58.325832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e364a812-32ef-4232-a393-85b7b9d3c847 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:58.327324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e364a812-32ef-4232-a393-85b7b9d3c847 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:58.328475 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e364a812-32ef-4232-a393-85b7b9d3c847 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084901 Jul 28 03:48:58.329030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 619/1023] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:58 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:59.071878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-66e53013-e32f-45da-a54d-e9aa53f94d90 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:59.072526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-66e53013-e32f-45da-a54d-e9aa53f94d90 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:59.078199 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-66e53013-e32f-45da-a54d-e9aa53f94d90 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:59.078635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-66e53013-e32f-45da-a54d-e9aa53f94d90 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:59.079390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-66e53013-e32f-45da-a54d-e9aa53f94d90 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:59.079879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-66e53013-e32f-45da-a54d-e9aa53f94d90 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:59.138649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-66e53013-e32f-45da-a54d-e9aa53f94d90 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:59.146030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-66e53013-e32f-45da-a54d-e9aa53f94d90 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077694 Jul 28 03:48:59.146576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 620/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:48:59 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:59.346086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-079f8f7b-5cf1-4be2-835d-f8b6f41b26cb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:59.346690 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-079f8f7b-5cf1-4be2-835d-f8b6f41b26cb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:48:59.352826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-079f8f7b-5cf1-4be2-835d-f8b6f41b26cb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:59.353271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-079f8f7b-5cf1-4be2-835d-f8b6f41b26cb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:59.354032 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-079f8f7b-5cf1-4be2-835d-f8b6f41b26cb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:48:59.354464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-079f8f7b-5cf1-4be2-835d-f8b6f41b26cb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:48:59.412618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-079f8f7b-5cf1-4be2-835d-f8b6f41b26cb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:59.420569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-079f8f7b-5cf1-4be2-835d-f8b6f41b26cb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:59.422050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-079f8f7b-5cf1-4be2-835d-f8b6f41b26cb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:59.423147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-079f8f7b-5cf1-4be2-835d-f8b6f41b26cb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080720 Jul 28 03:48:59.423717 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 621/1025] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:48:59 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:00.164260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-42499aa6-2545-4b88-a07a-145f98576369 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:00.164827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-42499aa6-2545-4b88-a07a-145f98576369 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:00.170618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42499aa6-2545-4b88-a07a-145f98576369 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:00.171059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42499aa6-2545-4b88-a07a-145f98576369 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:00.171848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42499aa6-2545-4b88-a07a-145f98576369 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:00.172278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42499aa6-2545-4b88-a07a-145f98576369 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:00.231929 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-42499aa6-2545-4b88-a07a-145f98576369 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:00.239100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-42499aa6-2545-4b88-a07a-145f98576369 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080090 Jul 28 03:49:00.239656 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 622/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:00 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:00.441340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8aae7012-98a6-43eb-a960-cb9fe8b01d19 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:00.441871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8aae7012-98a6-43eb-a960-cb9fe8b01d19 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:00.447571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8aae7012-98a6-43eb-a960-cb9fe8b01d19 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:00.448054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8aae7012-98a6-43eb-a960-cb9fe8b01d19 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:00.448821 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8aae7012-98a6-43eb-a960-cb9fe8b01d19 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:00.449256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8aae7012-98a6-43eb-a960-cb9fe8b01d19 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:00.509056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8aae7012-98a6-43eb-a960-cb9fe8b01d19 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:00.517093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8aae7012-98a6-43eb-a960-cb9fe8b01d19 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:00.518556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8aae7012-98a6-43eb-a960-cb9fe8b01d19 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:00.520245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8aae7012-98a6-43eb-a960-cb9fe8b01d19 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082623 Jul 28 03:49:00.520796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 623/1027] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:00 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:01.255007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7ba27901-c3f2-408c-9b4f-8f94215ba9b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:01.255615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7ba27901-c3f2-408c-9b4f-8f94215ba9b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:01.262191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ba27901-c3f2-408c-9b4f-8f94215ba9b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:01.262633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ba27901-c3f2-408c-9b4f-8f94215ba9b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:01.263386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ba27901-c3f2-408c-9b4f-8f94215ba9b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:01.263851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ba27901-c3f2-408c-9b4f-8f94215ba9b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:01.322453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7ba27901-c3f2-408c-9b4f-8f94215ba9b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:01.329704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7ba27901-c3f2-408c-9b4f-8f94215ba9b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078313 Jul 28 03:49:01.330260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 624/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:01 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:01.537531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8cf98186-d489-4b96-946d-aaf3dabf9c25 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:01.538064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8cf98186-d489-4b96-946d-aaf3dabf9c25 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:01.543609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8cf98186-d489-4b96-946d-aaf3dabf9c25 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:01.544098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8cf98186-d489-4b96-946d-aaf3dabf9c25 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:01.544862 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8cf98186-d489-4b96-946d-aaf3dabf9c25 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:01.545298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8cf98186-d489-4b96-946d-aaf3dabf9c25 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:01.607100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8cf98186-d489-4b96-946d-aaf3dabf9c25 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:01.615302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8cf98186-d489-4b96-946d-aaf3dabf9c25 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:01.616834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8cf98186-d489-4b96-946d-aaf3dabf9c25 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:01.617935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8cf98186-d489-4b96-946d-aaf3dabf9c25 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084045 Jul 28 03:49:01.618491 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 625/1029] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:01 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:02.346372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1ff0b783-e86b-4fd1-ab42-7667705efae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:02.347502 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1ff0b783-e86b-4fd1-ab42-7667705efae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:02.353794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ff0b783-e86b-4fd1-ab42-7667705efae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:02.354241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ff0b783-e86b-4fd1-ab42-7667705efae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:02.354996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ff0b783-e86b-4fd1-ab42-7667705efae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:02.355427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1ff0b783-e86b-4fd1-ab42-7667705efae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:02.413983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1ff0b783-e86b-4fd1-ab42-7667705efae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:02.421091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1ff0b783-e86b-4fd1-ab42-7667705efae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078420 Jul 28 03:49:02.421647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 626/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:02 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:02.634873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-32e682e8-1cb2-4a6f-9f9d-9ccdf02e4c6c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:02.635401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-32e682e8-1cb2-4a6f-9f9d-9ccdf02e4c6c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:02.641161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32e682e8-1cb2-4a6f-9f9d-9ccdf02e4c6c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:02.641607 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32e682e8-1cb2-4a6f-9f9d-9ccdf02e4c6c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:02.642366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32e682e8-1cb2-4a6f-9f9d-9ccdf02e4c6c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:02.642799 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32e682e8-1cb2-4a6f-9f9d-9ccdf02e4c6c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:02.700846 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-32e682e8-1cb2-4a6f-9f9d-9ccdf02e4c6c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:02.709423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-32e682e8-1cb2-4a6f-9f9d-9ccdf02e4c6c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:02.710905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-32e682e8-1cb2-4a6f-9f9d-9ccdf02e4c6c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:02.712112 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-32e682e8-1cb2-4a6f-9f9d-9ccdf02e4c6c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080795 Jul 28 03:49:02.712656 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 627/1031] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:02 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:03.438990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b19cdeca-cb9b-4b67-8269-85172f121357 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:03.439680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b19cdeca-cb9b-4b67-8269-85172f121357 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:03.446093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b19cdeca-cb9b-4b67-8269-85172f121357 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:03.446536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b19cdeca-cb9b-4b67-8269-85172f121357 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:03.447296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b19cdeca-cb9b-4b67-8269-85172f121357 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:03.447814 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b19cdeca-cb9b-4b67-8269-85172f121357 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:03.506280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b19cdeca-cb9b-4b67-8269-85172f121357 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:03.513524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b19cdeca-cb9b-4b67-8269-85172f121357 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078446 Jul 28 03:49:03.514076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 628/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:03 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:03.730553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d237da10-24d7-4945-9884-9226452667a3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:03.731079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d237da10-24d7-4945-9884-9226452667a3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:03.736851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d237da10-24d7-4945-9884-9226452667a3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:03.737289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d237da10-24d7-4945-9884-9226452667a3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:03.738966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d237da10-24d7-4945-9884-9226452667a3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:03.739403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d237da10-24d7-4945-9884-9226452667a3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:03.796822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d237da10-24d7-4945-9884-9226452667a3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:03.805673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d237da10-24d7-4945-9884-9226452667a3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:03.807147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d237da10-24d7-4945-9884-9226452667a3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:03.808285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d237da10-24d7-4945-9884-9226452667a3 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081523 Jul 28 03:49:03.808829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 629/1033] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:03 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:04.530656 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-87ad860d-1d8d-444c-929e-be687d561d7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:04.531266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-87ad860d-1d8d-444c-929e-be687d561d7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:04.537329 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87ad860d-1d8d-444c-929e-be687d561d7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:04.537771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87ad860d-1d8d-444c-929e-be687d561d7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:04.538523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87ad860d-1d8d-444c-929e-be687d561d7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:04.538952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87ad860d-1d8d-444c-929e-be687d561d7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:04.598294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-87ad860d-1d8d-444c-929e-be687d561d7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:04.605764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-87ad860d-1d8d-444c-929e-be687d561d7d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078809 Jul 28 03:49:04.606318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 630/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:04 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:04.825831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-98721f74-6b50-49ec-9aae-502ebb97e178 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:04.826362 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-98721f74-6b50-49ec-9aae-502ebb97e178 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:04.831953 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98721f74-6b50-49ec-9aae-502ebb97e178 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:04.832399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98721f74-6b50-49ec-9aae-502ebb97e178 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:04.833153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98721f74-6b50-49ec-9aae-502ebb97e178 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:04.833585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98721f74-6b50-49ec-9aae-502ebb97e178 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:04.896106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-98721f74-6b50-49ec-9aae-502ebb97e178 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:04.904118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-98721f74-6b50-49ec-9aae-502ebb97e178 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:04.905600 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-98721f74-6b50-49ec-9aae-502ebb97e178 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:04.906699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-98721f74-6b50-49ec-9aae-502ebb97e178 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084404 Jul 28 03:49:04.907243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 631/1035] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:04 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:05.622314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-771d1540-dc67-4c30-9b72-0c77c55a203e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:05.622953 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-771d1540-dc67-4c30-9b72-0c77c55a203e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:05.629206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-771d1540-dc67-4c30-9b72-0c77c55a203e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:05.629206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-771d1540-dc67-4c30-9b72-0c77c55a203e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:05.629930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-771d1540-dc67-4c30-9b72-0c77c55a203e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:05.630354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-771d1540-dc67-4c30-9b72-0c77c55a203e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:05.688243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-771d1540-dc67-4c30-9b72-0c77c55a203e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:05.695462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-771d1540-dc67-4c30-9b72-0c77c55a203e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.076742 Jul 28 03:49:05.696042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 632/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:05 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:05.924593 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-89a738e4-8246-425b-81f2-89ce670bb6ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:05.925241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-89a738e4-8246-425b-81f2-89ce670bb6ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:05.930957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89a738e4-8246-425b-81f2-89ce670bb6ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:05.931404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89a738e4-8246-425b-81f2-89ce670bb6ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:05.932194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89a738e4-8246-425b-81f2-89ce670bb6ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:05.932625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89a738e4-8246-425b-81f2-89ce670bb6ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:05.991761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-89a738e4-8246-425b-81f2-89ce670bb6ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:05.999829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-89a738e4-8246-425b-81f2-89ce670bb6ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:06.001314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-89a738e4-8246-425b-81f2-89ce670bb6ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:06.002415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-89a738e4-8246-425b-81f2-89ce670bb6ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081544 Jul 28 03:49:06.002963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 633/1037] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:05 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:06.712246 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-18414e09-b323-4ba5-89e0-fa14aa785584 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:06.712873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-18414e09-b323-4ba5-89e0-fa14aa785584 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:06.718628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18414e09-b323-4ba5-89e0-fa14aa785584 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:06.719069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18414e09-b323-4ba5-89e0-fa14aa785584 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:06.719849 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18414e09-b323-4ba5-89e0-fa14aa785584 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:06.720276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18414e09-b323-4ba5-89e0-fa14aa785584 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:06.779678 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-18414e09-b323-4ba5-89e0-fa14aa785584 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:06.787525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-18414e09-b323-4ba5-89e0-fa14aa785584 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078979 Jul 28 03:49:06.788116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 634/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:06 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:07.020876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0d296803-8246-4ceb-b17a-5739d312f8b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:07.021401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0d296803-8246-4ceb-b17a-5739d312f8b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:07.027052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d296803-8246-4ceb-b17a-5739d312f8b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:07.027495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d296803-8246-4ceb-b17a-5739d312f8b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:07.028425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d296803-8246-4ceb-b17a-5739d312f8b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:07.028856 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d296803-8246-4ceb-b17a-5739d312f8b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:07.089649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0d296803-8246-4ceb-b17a-5739d312f8b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:07.098785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0d296803-8246-4ceb-b17a-5739d312f8b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:07.100686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0d296803-8246-4ceb-b17a-5739d312f8b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:07.101785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0d296803-8246-4ceb-b17a-5739d312f8b2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.085095 Jul 28 03:49:07.102331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 635/1039] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:07 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:07.416409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:49:07.416648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 03:49:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 03:49:07.804403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8e72b0fc-95cc-48b1-81af-57ca03275b54 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:07.805032 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8e72b0fc-95cc-48b1-81af-57ca03275b54 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:07.810749 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e72b0fc-95cc-48b1-81af-57ca03275b54 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:07.811193 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e72b0fc-95cc-48b1-81af-57ca03275b54 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:07.811983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e72b0fc-95cc-48b1-81af-57ca03275b54 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:07.812419 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e72b0fc-95cc-48b1-81af-57ca03275b54 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:07.873500 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8e72b0fc-95cc-48b1-81af-57ca03275b54 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:07.880824 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8e72b0fc-95cc-48b1-81af-57ca03275b54 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080201 Jul 28 03:49:07.881380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 636/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:07 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:08.119382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0599291a-8a66-4f0e-a677-a89073c345fb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:08.120048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0599291a-8a66-4f0e-a677-a89073c345fb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:08.126004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0599291a-8a66-4f0e-a677-a89073c345fb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:08.126490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0599291a-8a66-4f0e-a677-a89073c345fb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:08.127298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0599291a-8a66-4f0e-a677-a89073c345fb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:08.127752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0599291a-8a66-4f0e-a677-a89073c345fb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:08.192274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0599291a-8a66-4f0e-a677-a89073c345fb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:08.203901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0599291a-8a66-4f0e-a677-a89073c345fb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:08.205380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0599291a-8a66-4f0e-a677-a89073c345fb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:08.206609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0599291a-8a66-4f0e-a677-a89073c345fb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.090845 Jul 28 03:49:08.207170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 637/1041] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:08 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:08.897506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a8b5ba4b-606c-4e84-b989-67df95af0354 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:08.898166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a8b5ba4b-606c-4e84-b989-67df95af0354 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:08.903948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a8b5ba4b-606c-4e84-b989-67df95af0354 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:08.904392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a8b5ba4b-606c-4e84-b989-67df95af0354 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:08.905150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a8b5ba4b-606c-4e84-b989-67df95af0354 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:08.905577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a8b5ba4b-606c-4e84-b989-67df95af0354 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:08.963303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a8b5ba4b-606c-4e84-b989-67df95af0354 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:08.970307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a8b5ba4b-606c-4e84-b989-67df95af0354 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.076631 Jul 28 03:49:08.970854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 638/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:08 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:09.224931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-efc12bc1-afe3-4073-b61f-330213f9e273 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:09.225459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-efc12bc1-afe3-4073-b61f-330213f9e273 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:09.231183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-efc12bc1-afe3-4073-b61f-330213f9e273 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:09.231625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-efc12bc1-afe3-4073-b61f-330213f9e273 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:09.232410 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-efc12bc1-afe3-4073-b61f-330213f9e273 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:09.232840 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-efc12bc1-afe3-4073-b61f-330213f9e273 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:09.291348 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-efc12bc1-afe3-4073-b61f-330213f9e273 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:09.299528 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-efc12bc1-afe3-4073-b61f-330213f9e273 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:09.301034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-efc12bc1-afe3-4073-b61f-330213f9e273 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:09.302131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-efc12bc1-afe3-4073-b61f-330213f9e273 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081850 Jul 28 03:49:09.302670 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 639/1043] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:09 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:09.988346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1658fea3-64eb-43ae-a24e-4476bd040351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:09.989082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1658fea3-64eb-43ae-a24e-4476bd040351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:09.994825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1658fea3-64eb-43ae-a24e-4476bd040351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:09.995278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1658fea3-64eb-43ae-a24e-4476bd040351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:09.996063 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1658fea3-64eb-43ae-a24e-4476bd040351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:09.996493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1658fea3-64eb-43ae-a24e-4476bd040351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:10.055614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1658fea3-64eb-43ae-a24e-4476bd040351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:10.062731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1658fea3-64eb-43ae-a24e-4476bd040351 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078806 Jul 28 03:49:10.063274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 640/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:09 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:10.319856 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3b6b5e97-14d0-4108-8f06-a5f456d6649b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:10.320385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3b6b5e97-14d0-4108-8f06-a5f456d6649b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:10.326134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b6b5e97-14d0-4108-8f06-a5f456d6649b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:10.326590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b6b5e97-14d0-4108-8f06-a5f456d6649b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:10.327354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b6b5e97-14d0-4108-8f06-a5f456d6649b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:10.327823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b6b5e97-14d0-4108-8f06-a5f456d6649b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:10.386788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3b6b5e97-14d0-4108-8f06-a5f456d6649b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:10.395322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3b6b5e97-14d0-4108-8f06-a5f456d6649b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:10.396833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3b6b5e97-14d0-4108-8f06-a5f456d6649b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:10.397930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3b6b5e97-14d0-4108-8f06-a5f456d6649b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081974 Jul 28 03:49:10.398467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 641/1045] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:10 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:11.080023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a1f7f2a3-6b7b-44ff-a811-62b719d1fabe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:11.080684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a1f7f2a3-6b7b-44ff-a811-62b719d1fabe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:11.086912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a1f7f2a3-6b7b-44ff-a811-62b719d1fabe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:11.087353 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a1f7f2a3-6b7b-44ff-a811-62b719d1fabe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:11.088140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a1f7f2a3-6b7b-44ff-a811-62b719d1fabe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:11.088576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a1f7f2a3-6b7b-44ff-a811-62b719d1fabe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:11.148456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a1f7f2a3-6b7b-44ff-a811-62b719d1fabe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:11.155569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a1f7f2a3-6b7b-44ff-a811-62b719d1fabe tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079246 Jul 28 03:49:11.156140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 642/1046] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:11 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:11.415698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ad4c8086-b766-47ed-b9db-b9b295d32ea1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:11.416317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ad4c8086-b766-47ed-b9db-b9b295d32ea1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:11.422165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad4c8086-b766-47ed-b9db-b9b295d32ea1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:11.422603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad4c8086-b766-47ed-b9db-b9b295d32ea1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:11.423358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad4c8086-b766-47ed-b9db-b9b295d32ea1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:11.423816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad4c8086-b766-47ed-b9db-b9b295d32ea1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:11.488539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ad4c8086-b766-47ed-b9db-b9b295d32ea1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:11.496785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ad4c8086-b766-47ed-b9db-b9b295d32ea1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:11.498271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ad4c8086-b766-47ed-b9db-b9b295d32ea1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:11.499379 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ad4c8086-b766-47ed-b9db-b9b295d32ea1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.087489 Jul 28 03:49:11.499967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 643/1047] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:11 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:12.173163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-79bca1dc-b3bd-4e21-80c5-71113d1ab651 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:12.173739 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-79bca1dc-b3bd-4e21-80c5-71113d1ab651 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:12.180118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79bca1dc-b3bd-4e21-80c5-71113d1ab651 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:12.180563 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79bca1dc-b3bd-4e21-80c5-71113d1ab651 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:12.181318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79bca1dc-b3bd-4e21-80c5-71113d1ab651 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:12.181741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79bca1dc-b3bd-4e21-80c5-71113d1ab651 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:12.243891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-79bca1dc-b3bd-4e21-80c5-71113d1ab651 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:12.250998 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-79bca1dc-b3bd-4e21-80c5-71113d1ab651 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.081594 Jul 28 03:49:12.251557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 644/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:12 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:12.517562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cb5a61d4-3ed3-43f2-8731-3227d04451eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:12.518105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cb5a61d4-3ed3-43f2-8731-3227d04451eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:12.524659 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb5a61d4-3ed3-43f2-8731-3227d04451eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:12.525108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb5a61d4-3ed3-43f2-8731-3227d04451eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:12.525877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb5a61d4-3ed3-43f2-8731-3227d04451eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:12.526310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cb5a61d4-3ed3-43f2-8731-3227d04451eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:12.585257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cb5a61d4-3ed3-43f2-8731-3227d04451eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:12.593357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cb5a61d4-3ed3-43f2-8731-3227d04451eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:12.594836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cb5a61d4-3ed3-43f2-8731-3227d04451eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:12.595975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cb5a61d4-3ed3-43f2-8731-3227d04451eb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082104 Jul 28 03:49:12.596516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 645/1049] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:12 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:13.267638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c6d35ed6-248d-4981-82f7-e01eaecacf18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:13.268299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c6d35ed6-248d-4981-82f7-e01eaecacf18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:13.274216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6d35ed6-248d-4981-82f7-e01eaecacf18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:13.274661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6d35ed6-248d-4981-82f7-e01eaecacf18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:13.275427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6d35ed6-248d-4981-82f7-e01eaecacf18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:13.275899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6d35ed6-248d-4981-82f7-e01eaecacf18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:13.333958 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c6d35ed6-248d-4981-82f7-e01eaecacf18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:13.341043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c6d35ed6-248d-4981-82f7-e01eaecacf18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077061 Jul 28 03:49:13.341598 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 646/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:13 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:13.614254 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4dcc4a48-59b3-45aa-b84c-5d93246832c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:13.614856 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4dcc4a48-59b3-45aa-b84c-5d93246832c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:13.620584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4dcc4a48-59b3-45aa-b84c-5d93246832c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:13.621030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4dcc4a48-59b3-45aa-b84c-5d93246832c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:13.621786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4dcc4a48-59b3-45aa-b84c-5d93246832c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:13.622217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4dcc4a48-59b3-45aa-b84c-5d93246832c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:13.680529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4dcc4a48-59b3-45aa-b84c-5d93246832c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:13.688503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4dcc4a48-59b3-45aa-b84c-5d93246832c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:13.689982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4dcc4a48-59b3-45aa-b84c-5d93246832c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:13.691278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4dcc4a48-59b3-45aa-b84c-5d93246832c9 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081276 Jul 28 03:49:13.691851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 647/1051] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:13 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:14.358366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a610a6e9-3e51-4bf4-9e8e-dc60ad947032 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:14.358976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a610a6e9-3e51-4bf4-9e8e-dc60ad947032 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:14.365253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a610a6e9-3e51-4bf4-9e8e-dc60ad947032 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:14.365709 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a610a6e9-3e51-4bf4-9e8e-dc60ad947032 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:14.366475 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a610a6e9-3e51-4bf4-9e8e-dc60ad947032 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:14.366913 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a610a6e9-3e51-4bf4-9e8e-dc60ad947032 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:14.425377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a610a6e9-3e51-4bf4-9e8e-dc60ad947032 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:14.432714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a610a6e9-3e51-4bf4-9e8e-dc60ad947032 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077993 Jul 28 03:49:14.433267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 648/1052] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:14 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:14.709174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-217cc36a-5925-41a5-87fe-1fa5293b6fec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:14.709713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-217cc36a-5925-41a5-87fe-1fa5293b6fec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:14.715383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-217cc36a-5925-41a5-87fe-1fa5293b6fec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:14.715875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-217cc36a-5925-41a5-87fe-1fa5293b6fec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:14.716639 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-217cc36a-5925-41a5-87fe-1fa5293b6fec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:14.717069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-217cc36a-5925-41a5-87fe-1fa5293b6fec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:14.778914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-217cc36a-5925-41a5-87fe-1fa5293b6fec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:14.787774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-217cc36a-5925-41a5-87fe-1fa5293b6fec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:14.789260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-217cc36a-5925-41a5-87fe-1fa5293b6fec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:14.790365 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-217cc36a-5925-41a5-87fe-1fa5293b6fec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084975 Jul 28 03:49:14.790909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 649/1053] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:14 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:15.450613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e74c7db6-dcbd-4208-9487-47d6e2231dea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:15.451228 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e74c7db6-dcbd-4208-9487-47d6e2231dea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:15.457019 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e74c7db6-dcbd-4208-9487-47d6e2231dea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:15.457462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e74c7db6-dcbd-4208-9487-47d6e2231dea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:15.458222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e74c7db6-dcbd-4208-9487-47d6e2231dea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:15.458656 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e74c7db6-dcbd-4208-9487-47d6e2231dea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:15.517611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e74c7db6-dcbd-4208-9487-47d6e2231dea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:15.524766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e74c7db6-dcbd-4208-9487-47d6e2231dea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077863 Jul 28 03:49:15.525323 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 650/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:15 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:15.808634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-551a8416-2f0c-4611-92b4-3115c3b4c1d0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:15.809166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-551a8416-2f0c-4611-92b4-3115c3b4c1d0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:15.814957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-551a8416-2f0c-4611-92b4-3115c3b4c1d0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:15.815408 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-551a8416-2f0c-4611-92b4-3115c3b4c1d0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:15.816264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-551a8416-2f0c-4611-92b4-3115c3b4c1d0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:15.816701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-551a8416-2f0c-4611-92b4-3115c3b4c1d0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:15.874762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-551a8416-2f0c-4611-92b4-3115c3b4c1d0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:15.882846 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-551a8416-2f0c-4611-92b4-3115c3b4c1d0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:15.884386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-551a8416-2f0c-4611-92b4-3115c3b4c1d0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:15.885494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-551a8416-2f0c-4611-92b4-3115c3b4c1d0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080588 Jul 28 03:49:15.886040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 651/1055] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:15 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:16.541358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cd70eb11-84ad-479d-ab8e-549e896db0a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:16.541954 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cd70eb11-84ad-479d-ab8e-549e896db0a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:16.547667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd70eb11-84ad-479d-ab8e-549e896db0a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:16.548134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd70eb11-84ad-479d-ab8e-549e896db0a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:16.548881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd70eb11-84ad-479d-ab8e-549e896db0a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:16.549307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd70eb11-84ad-479d-ab8e-549e896db0a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:16.607940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cd70eb11-84ad-479d-ab8e-549e896db0a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:16.615121 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cd70eb11-84ad-479d-ab8e-549e896db0a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077505 Jul 28 03:49:16.615668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 652/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:16 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:16.902741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-59305c0f-f99e-4ec9-bcf6-b635f09c8d9f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:16.903347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-59305c0f-f99e-4ec9-bcf6-b635f09c8d9f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:16.909052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59305c0f-f99e-4ec9-bcf6-b635f09c8d9f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:16.909600 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59305c0f-f99e-4ec9-bcf6-b635f09c8d9f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:16.910360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59305c0f-f99e-4ec9-bcf6-b635f09c8d9f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:16.910864 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59305c0f-f99e-4ec9-bcf6-b635f09c8d9f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:16.969004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-59305c0f-f99e-4ec9-bcf6-b635f09c8d9f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:16.977308 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-59305c0f-f99e-4ec9-bcf6-b635f09c8d9f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:16.978782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-59305c0f-f99e-4ec9-bcf6-b635f09c8d9f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:16.979912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-59305c0f-f99e-4ec9-bcf6-b635f09c8d9f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.080752 Jul 28 03:49:16.980452 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 653/1057] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:16 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:17.755358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e121b8aa-c98a-4dde-9820-2f6a8d16e099 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:17.756014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e121b8aa-c98a-4dde-9820-2f6a8d16e099 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:17.762030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e121b8aa-c98a-4dde-9820-2f6a8d16e099 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:17.762480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e121b8aa-c98a-4dde-9820-2f6a8d16e099 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:17.763253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e121b8aa-c98a-4dde-9820-2f6a8d16e099 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:17.763696 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e121b8aa-c98a-4dde-9820-2f6a8d16e099 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:17.823754 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e121b8aa-c98a-4dde-9820-2f6a8d16e099 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:17.831142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e121b8aa-c98a-4dde-9820-2f6a8d16e099 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.203224 Jul 28 03:49:17.832241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 654/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:17 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:17.998017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-757ec168-46c4-4c32-a029-c2dff16791e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:17.998619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-757ec168-46c4-4c32-a029-c2dff16791e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:18.005281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-757ec168-46c4-4c32-a029-c2dff16791e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:18.005728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-757ec168-46c4-4c32-a029-c2dff16791e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:18.006489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-757ec168-46c4-4c32-a029-c2dff16791e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:18.006921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-757ec168-46c4-4c32-a029-c2dff16791e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:18.071098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-757ec168-46c4-4c32-a029-c2dff16791e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:18.079214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-757ec168-46c4-4c32-a029-c2dff16791e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:18.080711 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-757ec168-46c4-4c32-a029-c2dff16791e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:18.082625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-757ec168-46c4-4c32-a029-c2dff16791e4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.088194 Jul 28 03:49:18.083176 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 655/1059] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:17 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:18.849307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a3a0b9f4-5522-48c5-a386-8d30f0003c91 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:18.850040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a3a0b9f4-5522-48c5-a386-8d30f0003c91 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:18.855946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a3a0b9f4-5522-48c5-a386-8d30f0003c91 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:18.856407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a3a0b9f4-5522-48c5-a386-8d30f0003c91 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:18.857242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a3a0b9f4-5522-48c5-a386-8d30f0003c91 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:18.857684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a3a0b9f4-5522-48c5-a386-8d30f0003c91 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:18.916184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a3a0b9f4-5522-48c5-a386-8d30f0003c91 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:18.923357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a3a0b9f4-5522-48c5-a386-8d30f0003c91 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078504 Jul 28 03:49:18.923935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 656/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:18 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:19.100337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2b17e925-20b8-41f6-a3c9-348c31fa6507 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:19.100895 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2b17e925-20b8-41f6-a3c9-348c31fa6507 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:19.106492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b17e925-20b8-41f6-a3c9-348c31fa6507 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:19.106938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b17e925-20b8-41f6-a3c9-348c31fa6507 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:19.107701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b17e925-20b8-41f6-a3c9-348c31fa6507 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:19.108159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b17e925-20b8-41f6-a3c9-348c31fa6507 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:19.167914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2b17e925-20b8-41f6-a3c9-348c31fa6507 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:19.176638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2b17e925-20b8-41f6-a3c9-348c31fa6507 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:19.178127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2b17e925-20b8-41f6-a3c9-348c31fa6507 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:19.179231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2b17e925-20b8-41f6-a3c9-348c31fa6507 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082717 Jul 28 03:49:19.179796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 657/1061] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:19 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:19.940546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b6529c79-6734-4cc2-8ab8-a05fe642a58d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:19.941246 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b6529c79-6734-4cc2-8ab8-a05fe642a58d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:19.946931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6529c79-6734-4cc2-8ab8-a05fe642a58d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:19.947378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6529c79-6734-4cc2-8ab8-a05fe642a58d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:19.948175 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6529c79-6734-4cc2-8ab8-a05fe642a58d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:19.948608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6529c79-6734-4cc2-8ab8-a05fe642a58d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:20.009412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b6529c79-6734-4cc2-8ab8-a05fe642a58d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:20.016558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b6529c79-6734-4cc2-8ab8-a05fe642a58d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079738 Jul 28 03:49:20.017108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 658/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:19 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:20.197361 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-caf92914-f650-464f-81a7-f744b134d76c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:20.197892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-caf92914-f650-464f-81a7-f744b134d76c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:20.203588 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caf92914-f650-464f-81a7-f744b134d76c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:20.204103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caf92914-f650-464f-81a7-f744b134d76c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:20.204859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caf92914-f650-464f-81a7-f744b134d76c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:20.205287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caf92914-f650-464f-81a7-f744b134d76c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:20.264400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-caf92914-f650-464f-81a7-f744b134d76c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:20.273100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-caf92914-f650-464f-81a7-f744b134d76c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:20.274578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-caf92914-f650-464f-81a7-f744b134d76c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:20.275676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-caf92914-f650-464f-81a7-f744b134d76c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082022 Jul 28 03:49:20.276247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 659/1063] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:20 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:21.033821 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3d33ddb8-7555-49bd-92fc-6688b8f4491a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:21.035027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3d33ddb8-7555-49bd-92fc-6688b8f4491a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:21.040742 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d33ddb8-7555-49bd-92fc-6688b8f4491a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:21.041182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d33ddb8-7555-49bd-92fc-6688b8f4491a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:21.041936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d33ddb8-7555-49bd-92fc-6688b8f4491a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:21.042361 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d33ddb8-7555-49bd-92fc-6688b8f4491a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:21.100359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3d33ddb8-7555-49bd-92fc-6688b8f4491a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:21.107394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3d33ddb8-7555-49bd-92fc-6688b8f4491a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077249 Jul 28 03:49:21.107991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 660/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:21 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:21.293410 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e955d663-fbd3-4976-97a4-b732c6dbeb9e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:21.293941 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e955d663-fbd3-4976-97a4-b732c6dbeb9e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:21.299664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e955d663-fbd3-4976-97a4-b732c6dbeb9e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:21.300148 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e955d663-fbd3-4976-97a4-b732c6dbeb9e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:21.300973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e955d663-fbd3-4976-97a4-b732c6dbeb9e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:21.301397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e955d663-fbd3-4976-97a4-b732c6dbeb9e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:21.363927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e955d663-fbd3-4976-97a4-b732c6dbeb9e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:21.372129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e955d663-fbd3-4976-97a4-b732c6dbeb9e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:21.373618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e955d663-fbd3-4976-97a4-b732c6dbeb9e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:21.374729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e955d663-fbd3-4976-97a4-b732c6dbeb9e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.085040 Jul 28 03:49:21.375280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 661/1065] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:21 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:22.125521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-134fb0f1-2a0e-4ebc-8a4c-9cd81c9e03af tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:22.126139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-134fb0f1-2a0e-4ebc-8a4c-9cd81c9e03af tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:22.133217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-134fb0f1-2a0e-4ebc-8a4c-9cd81c9e03af tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:22.133721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-134fb0f1-2a0e-4ebc-8a4c-9cd81c9e03af tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:22.134498 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-134fb0f1-2a0e-4ebc-8a4c-9cd81c9e03af tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:22.134935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-134fb0f1-2a0e-4ebc-8a4c-9cd81c9e03af tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:22.193447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-134fb0f1-2a0e-4ebc-8a4c-9cd81c9e03af tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:22.201206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-134fb0f1-2a0e-4ebc-8a4c-9cd81c9e03af tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079360 Jul 28 03:49:22.201827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 662/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:22 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:22.392700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4919b25e-1081-4d25-83b6-84d1a5aefe03 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:22.393301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4919b25e-1081-4d25-83b6-84d1a5aefe03 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:22.399203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4919b25e-1081-4d25-83b6-84d1a5aefe03 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:22.399650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4919b25e-1081-4d25-83b6-84d1a5aefe03 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:22.400440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4919b25e-1081-4d25-83b6-84d1a5aefe03 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:22.400874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4919b25e-1081-4d25-83b6-84d1a5aefe03 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:22.459441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4919b25e-1081-4d25-83b6-84d1a5aefe03 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:22.467493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4919b25e-1081-4d25-83b6-84d1a5aefe03 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:22.469023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4919b25e-1081-4d25-83b6-84d1a5aefe03 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:22.470119 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4919b25e-1081-4d25-83b6-84d1a5aefe03 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081087 Jul 28 03:49:22.470657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 663/1067] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:22 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:23.218259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-68605ceb-5602-43d3-8393-683cea160fb5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:23.218845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-68605ceb-5602-43d3-8393-683cea160fb5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:23.224922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68605ceb-5602-43d3-8393-683cea160fb5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:23.225371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68605ceb-5602-43d3-8393-683cea160fb5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:23.226135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68605ceb-5602-43d3-8393-683cea160fb5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:23.226571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68605ceb-5602-43d3-8393-683cea160fb5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:23.286359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-68605ceb-5602-43d3-8393-683cea160fb5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:23.293681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-68605ceb-5602-43d3-8393-683cea160fb5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079160 Jul 28 03:49:23.294241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 664/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:23 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:23.488395 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-29e16491-623f-40ff-ab79-1350afc31c44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:23.488923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-29e16491-623f-40ff-ab79-1350afc31c44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:23.494632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e16491-623f-40ff-ab79-1350afc31c44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:23.495091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e16491-623f-40ff-ab79-1350afc31c44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:23.495897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e16491-623f-40ff-ab79-1350afc31c44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:23.496335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e16491-623f-40ff-ab79-1350afc31c44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:23.554928 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-29e16491-623f-40ff-ab79-1350afc31c44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:23.563048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-29e16491-623f-40ff-ab79-1350afc31c44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:23.564578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-29e16491-623f-40ff-ab79-1350afc31c44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:23.566419 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-29e16491-623f-40ff-ab79-1350afc31c44 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.082372 Jul 28 03:49:23.566974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 665/1069] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:23 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:24.310061 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-59bcc836-3ca7-44ec-bcf0-5ea8d1834fba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:24.310672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-59bcc836-3ca7-44ec-bcf0-5ea8d1834fba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:24.317372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59bcc836-3ca7-44ec-bcf0-5ea8d1834fba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:24.317815 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59bcc836-3ca7-44ec-bcf0-5ea8d1834fba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:24.318572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59bcc836-3ca7-44ec-bcf0-5ea8d1834fba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:24.319003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-59bcc836-3ca7-44ec-bcf0-5ea8d1834fba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:24.378754 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-59bcc836-3ca7-44ec-bcf0-5ea8d1834fba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:24.385904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-59bcc836-3ca7-44ec-bcf0-5ea8d1834fba tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079484 Jul 28 03:49:24.386455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 666/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:24 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:24.584640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-929ab314-ebc4-4c2d-83f9-3fdc4019dc17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:24.585158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-929ab314-ebc4-4c2d-83f9-3fdc4019dc17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:24.590811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-929ab314-ebc4-4c2d-83f9-3fdc4019dc17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:24.591256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-929ab314-ebc4-4c2d-83f9-3fdc4019dc17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:24.592051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-929ab314-ebc4-4c2d-83f9-3fdc4019dc17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:24.592484 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-929ab314-ebc4-4c2d-83f9-3fdc4019dc17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:24.654241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-929ab314-ebc4-4c2d-83f9-3fdc4019dc17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:24.662427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-929ab314-ebc4-4c2d-83f9-3fdc4019dc17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:24.664009 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-929ab314-ebc4-4c2d-83f9-3fdc4019dc17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:24.665109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-929ab314-ebc4-4c2d-83f9-3fdc4019dc17 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.084683 Jul 28 03:49:24.665647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 667/1071] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:24 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:25.402916 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dad540d1-7eb8-4505-9134-cebd78805113 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:25.403554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dad540d1-7eb8-4505-9134-cebd78805113 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:25.409765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dad540d1-7eb8-4505-9134-cebd78805113 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:25.410215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dad540d1-7eb8-4505-9134-cebd78805113 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:25.410968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dad540d1-7eb8-4505-9134-cebd78805113 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:25.411399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dad540d1-7eb8-4505-9134-cebd78805113 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:25.468668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dad540d1-7eb8-4505-9134-cebd78805113 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:25.476769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dad540d1-7eb8-4505-9134-cebd78805113 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077526 Jul 28 03:49:25.477343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 668/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:25 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:25.681930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5787c574-5603-42b1-9a85-42ebcbe2c0c4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:25.682466 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5787c574-5603-42b1-9a85-42ebcbe2c0c4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:25.688144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5787c574-5603-42b1-9a85-42ebcbe2c0c4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:25.688591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5787c574-5603-42b1-9a85-42ebcbe2c0c4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:25.689349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5787c574-5603-42b1-9a85-42ebcbe2c0c4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:25.689783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5787c574-5603-42b1-9a85-42ebcbe2c0c4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:25.748844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5787c574-5603-42b1-9a85-42ebcbe2c0c4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:25.757099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5787c574-5603-42b1-9a85-42ebcbe2c0c4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:25.758591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5787c574-5603-42b1-9a85-42ebcbe2c0c4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:25.759699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5787c574-5603-42b1-9a85-42ebcbe2c0c4 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081376 Jul 28 03:49:25.760275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 669/1073] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:25 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:26.493865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b77880d8-1709-4d2f-81c8-be8acbb53145 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:26.494530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b77880d8-1709-4d2f-81c8-be8acbb53145 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:26.500280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b77880d8-1709-4d2f-81c8-be8acbb53145 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:26.500722 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b77880d8-1709-4d2f-81c8-be8acbb53145 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:26.501473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b77880d8-1709-4d2f-81c8-be8acbb53145 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:26.501898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b77880d8-1709-4d2f-81c8-be8acbb53145 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:26.559914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b77880d8-1709-4d2f-81c8-be8acbb53145 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:26.567627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b77880d8-1709-4d2f-81c8-be8acbb53145 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077411 Jul 28 03:49:26.568211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 670/1074] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:26 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:26.777735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-25350122-229d-4349-b5a0-0662a3eac12c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:26.778266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-25350122-229d-4349-b5a0-0662a3eac12c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:26.784501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25350122-229d-4349-b5a0-0662a3eac12c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:26.784954 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25350122-229d-4349-b5a0-0662a3eac12c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:26.785707 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25350122-229d-4349-b5a0-0662a3eac12c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:26.786142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25350122-229d-4349-b5a0-0662a3eac12c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:26.843910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-25350122-229d-4349-b5a0-0662a3eac12c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:26.852653 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-25350122-229d-4349-b5a0-0662a3eac12c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:26.854137 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-25350122-229d-4349-b5a0-0662a3eac12c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:26.855241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-25350122-229d-4349-b5a0-0662a3eac12c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081169 Jul 28 03:49:26.855812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 671/1075] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:26 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:27.585091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-35d3ba32-629a-4640-90b9-d320c976a0d8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:27.585693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-35d3ba32-629a-4640-90b9-d320c976a0d8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:27.591786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-35d3ba32-629a-4640-90b9-d320c976a0d8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:27.592244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-35d3ba32-629a-4640-90b9-d320c976a0d8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:27.593012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-35d3ba32-629a-4640-90b9-d320c976a0d8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:27.593445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-35d3ba32-629a-4640-90b9-d320c976a0d8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:27.651671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-35d3ba32-629a-4640-90b9-d320c976a0d8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:27.658824 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-35d3ba32-629a-4640-90b9-d320c976a0d8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078103 Jul 28 03:49:27.659375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 672/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:27 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:27.872818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1f8b6463-819b-419a-addb-c4ab7fd8d6cf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:27.873425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1f8b6463-819b-419a-addb-c4ab7fd8d6cf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:27.879799 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1f8b6463-819b-419a-addb-c4ab7fd8d6cf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:27.880250 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1f8b6463-819b-419a-addb-c4ab7fd8d6cf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:27.881010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1f8b6463-819b-419a-addb-c4ab7fd8d6cf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:27.881522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1f8b6463-819b-419a-addb-c4ab7fd8d6cf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:27.945418 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1f8b6463-819b-419a-addb-c4ab7fd8d6cf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:27.953601 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1f8b6463-819b-419a-addb-c4ab7fd8d6cf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:27.955083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1f8b6463-819b-419a-addb-c4ab7fd8d6cf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:27.956445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1f8b6463-819b-419a-addb-c4ab7fd8d6cf tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.087088 Jul 28 03:49:27.957092 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 673/1077] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:27 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:28.676006 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dbdcc9eb-7fa0-486a-9c2f-66a04b3e7cbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:28.676669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dbdcc9eb-7fa0-486a-9c2f-66a04b3e7cbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:28.682283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbdcc9eb-7fa0-486a-9c2f-66a04b3e7cbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:28.682728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbdcc9eb-7fa0-486a-9c2f-66a04b3e7cbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:28.683505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbdcc9eb-7fa0-486a-9c2f-66a04b3e7cbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:28.683947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dbdcc9eb-7fa0-486a-9c2f-66a04b3e7cbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:28.742190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dbdcc9eb-7fa0-486a-9c2f-66a04b3e7cbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:28.749381 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dbdcc9eb-7fa0-486a-9c2f-66a04b3e7cbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077626 Jul 28 03:49:28.749930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 674/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:28 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:28.974949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2c97cd50-add5-49a2-948f-dab325d21e0b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:28.975557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2c97cd50-add5-49a2-948f-dab325d21e0b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:28.981246 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c97cd50-add5-49a2-948f-dab325d21e0b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:28.981701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c97cd50-add5-49a2-948f-dab325d21e0b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:28.982462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c97cd50-add5-49a2-948f-dab325d21e0b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:28.982907 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c97cd50-add5-49a2-948f-dab325d21e0b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:29.042827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2c97cd50-add5-49a2-948f-dab325d21e0b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:29.051091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2c97cd50-add5-49a2-948f-dab325d21e0b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:29.052591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2c97cd50-add5-49a2-948f-dab325d21e0b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:29.053699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2c97cd50-add5-49a2-948f-dab325d21e0b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.083305 Jul 28 03:49:29.054219 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 675/1079] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:28 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:29.765974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e2457010-29cf-4e65-995e-bc0d1af4f624 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:29.766616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e2457010-29cf-4e65-995e-bc0d1af4f624 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:29.772871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2457010-29cf-4e65-995e-bc0d1af4f624 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:29.773323 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2457010-29cf-4e65-995e-bc0d1af4f624 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:29.774092 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2457010-29cf-4e65-995e-bc0d1af4f624 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:29.774531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2457010-29cf-4e65-995e-bc0d1af4f624 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:29.833634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e2457010-29cf-4e65-995e-bc0d1af4f624 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:29.840947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e2457010-29cf-4e65-995e-bc0d1af4f624 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078595 Jul 28 03:49:29.841501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 676/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:29 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:30.071984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6825f21c-033a-4bcb-8fbc-7105a8c08438 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:30.072531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6825f21c-033a-4bcb-8fbc-7105a8c08438 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:30.078267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6825f21c-033a-4bcb-8fbc-7105a8c08438 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:30.078714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6825f21c-033a-4bcb-8fbc-7105a8c08438 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:30.079480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6825f21c-033a-4bcb-8fbc-7105a8c08438 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:30.079941 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6825f21c-033a-4bcb-8fbc-7105a8c08438 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:30.138610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6825f21c-033a-4bcb-8fbc-7105a8c08438 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:30.147520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6825f21c-033a-4bcb-8fbc-7105a8c08438 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:30.149043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6825f21c-033a-4bcb-8fbc-7105a8c08438 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:30.150174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6825f21c-033a-4bcb-8fbc-7105a8c08438 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081855 Jul 28 03:49:30.150723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 677/1081] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:30 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:30.858003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ba14a791-7017-4b43-a02b-a6af511699f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:30.858664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ba14a791-7017-4b43-a02b-a6af511699f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:30.865018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ba14a791-7017-4b43-a02b-a6af511699f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:30.865465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ba14a791-7017-4b43-a02b-a6af511699f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:30.866233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ba14a791-7017-4b43-a02b-a6af511699f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:30.866662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ba14a791-7017-4b43-a02b-a6af511699f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:30.923987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ba14a791-7017-4b43-a02b-a6af511699f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:30.931780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ba14a791-7017-4b43-a02b-a6af511699f7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077394 Jul 28 03:49:30.932338 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 678/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:30 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:31.168940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8a33be05-bb05-43b3-bf2c-e5ed602e2f65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:31.169541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8a33be05-bb05-43b3-bf2c-e5ed602e2f65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:31.175784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a33be05-bb05-43b3-bf2c-e5ed602e2f65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:31.176232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a33be05-bb05-43b3-bf2c-e5ed602e2f65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:31.176988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a33be05-bb05-43b3-bf2c-e5ed602e2f65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:31.177414 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a33be05-bb05-43b3-bf2c-e5ed602e2f65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:31.239873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8a33be05-bb05-43b3-bf2c-e5ed602e2f65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:31.247944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8a33be05-bb05-43b3-bf2c-e5ed602e2f65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:31.249413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8a33be05-bb05-43b3-bf2c-e5ed602e2f65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:31.250507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8a33be05-bb05-43b3-bf2c-e5ed602e2f65 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.086093 Jul 28 03:49:31.251051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 679/1083] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:31 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:31.948649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2918e276-a647-4515-9fb9-56b153fe886a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:31.949291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2918e276-a647-4515-9fb9-56b153fe886a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:31.954998 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2918e276-a647-4515-9fb9-56b153fe886a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:31.955445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2918e276-a647-4515-9fb9-56b153fe886a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:31.956578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2918e276-a647-4515-9fb9-56b153fe886a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:31.957015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2918e276-a647-4515-9fb9-56b153fe886a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:32.024718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2918e276-a647-4515-9fb9-56b153fe886a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:32.032368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2918e276-a647-4515-9fb9-56b153fe886a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.087372 Jul 28 03:49:32.043292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 680/1084] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:31 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:32.268761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f32e182a-08c2-476b-bd74-b48b2ac800c7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:32.269405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f32e182a-08c2-476b-bd74-b48b2ac800c7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:32.275008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f32e182a-08c2-476b-bd74-b48b2ac800c7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:32.275463 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f32e182a-08c2-476b-bd74-b48b2ac800c7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:32.276266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f32e182a-08c2-476b-bd74-b48b2ac800c7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:32.276703 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f32e182a-08c2-476b-bd74-b48b2ac800c7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:32.335053 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f32e182a-08c2-476b-bd74-b48b2ac800c7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:32.343154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f32e182a-08c2-476b-bd74-b48b2ac800c7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:32.344668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f32e182a-08c2-476b-bd74-b48b2ac800c7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:32.345768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f32e182a-08c2-476b-bd74-b48b2ac800c7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.081376 Jul 28 03:49:32.346361 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 681/1085] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:32 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:33.050601 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-489763a2-40d6-445f-9131-04c56f441aa7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:33.051281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-489763a2-40d6-445f-9131-04c56f441aa7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:33.053489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 03:49:33.057877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-489763a2-40d6-445f-9131-04c56f441aa7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:33.058321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-489763a2-40d6-445f-9131-04c56f441aa7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:33.059088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-489763a2-40d6-445f-9131-04c56f441aa7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:33.059515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-489763a2-40d6-445f-9131-04c56f441aa7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:33.117976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-489763a2-40d6-445f-9131-04c56f441aa7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:33.125179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-489763a2-40d6-445f-9131-04c56f441aa7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078958 Jul 28 03:49:33.125734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 682/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:33 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:33.364139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-17a30a30-a1dc-425e-9e41-7012f7c74657 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:33.364747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-17a30a30-a1dc-425e-9e41-7012f7c74657 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:33.370676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17a30a30-a1dc-425e-9e41-7012f7c74657 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:33.371118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17a30a30-a1dc-425e-9e41-7012f7c74657 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:33.371927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17a30a30-a1dc-425e-9e41-7012f7c74657 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:33.372354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17a30a30-a1dc-425e-9e41-7012f7c74657 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:33.432625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-17a30a30-a1dc-425e-9e41-7012f7c74657 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:33.443240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-17a30a30-a1dc-425e-9e41-7012f7c74657 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:33.444779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-17a30a30-a1dc-425e-9e41-7012f7c74657 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:33.445910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-17a30a30-a1dc-425e-9e41-7012f7c74657 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 200 len: 1445 microversion: 2.20 time: 0.085532 Jul 28 03:49:33.446663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 683/1087] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:33 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:34.142214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e69ec4b4-0ae8-491a-9e70-2207c93c6fbb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:34.142834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e69ec4b4-0ae8-491a-9e70-2207c93c6fbb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:34.161275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e69ec4b4-0ae8-491a-9e70-2207c93c6fbb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:34.161747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e69ec4b4-0ae8-491a-9e70-2207c93c6fbb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:34.162516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e69ec4b4-0ae8-491a-9e70-2207c93c6fbb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:34.162946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e69ec4b4-0ae8-491a-9e70-2207c93c6fbb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:34.168970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33600. Jul 28 03:49:34.224487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e69ec4b4-0ae8-491a-9e70-2207c93c6fbb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:34.231783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e69ec4b4-0ae8-491a-9e70-2207c93c6fbb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.093228 Jul 28 03:49:34.232303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 684/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:34 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:34.463515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9fe696c0-7162-4ace-b680-08ccdf58e32d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:34.464100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9fe696c0-7162-4ace-b680-08ccdf58e32d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:34.469919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9fe696c0-7162-4ace-b680-08ccdf58e32d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:34.470370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9fe696c0-7162-4ace-b680-08ccdf58e32d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:34.471965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9fe696c0-7162-4ace-b680-08ccdf58e32d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:34.472223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9fe696c0-7162-4ace-b680-08ccdf58e32d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:34.485295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-9fe696c0-7162-4ace-b680-08ccdf58e32d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] HTTP exception thrown: Instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f could not be found. Jul 28 03:49:34.485882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9fe696c0-7162-4ace-b680-08ccdf58e32d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Returning 404 to user: Instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:49:34.486767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9fe696c0-7162-4ace-b680-08ccdf58e32d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 404 len: 111 microversion: 2.20 time: 0.026932 Jul 28 03:49:34.487928 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 685/1089] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:34 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:49:34.495873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-28baa728-55f8-4a95-a922-d8c57f5453bb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '.version_select at 0x7f6806909ca0>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:34.517313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-28baa728-55f8-4a95-a922-d8c57f5453bb tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791184133" status: 204 len: 0 microversion: 2.20 time: 0.024565 Jul 28 03:49:34.517728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 686/1090] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Jul 28 03:49:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791184133 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 03:49:35.249302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1229ccf7-ccd0-4a3a-acf1-624736515e87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:35.249972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1229ccf7-ccd0-4a3a-acf1-624736515e87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:35.257012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1229ccf7-ccd0-4a3a-acf1-624736515e87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:35.257465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1229ccf7-ccd0-4a3a-acf1-624736515e87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:35.258272 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1229ccf7-ccd0-4a3a-acf1-624736515e87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:35.258705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1229ccf7-ccd0-4a3a-acf1-624736515e87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:35.321692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1229ccf7-ccd0-4a3a-acf1-624736515e87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:35.329190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1229ccf7-ccd0-4a3a-acf1-624736515e87 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.083585 Jul 28 03:49:35.329751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 687/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:35 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:35.443997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eee01852-15ee-4c32-bcaf-b42099fd8f55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'create', calling method: .version_select at 0x7f6806957550>, body: {"keypair": {"name": "tempest-keypair-1390679599"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:35.461413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-eee01852-15ee-4c32-bcaf-b42099fd8f55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:49:35.465068 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-eee01852-15ee-4c32-bcaf-b42099fd8f55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for user fd82b48aabbb419cb891867d0b1a57e0 and project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:49:35.610433 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-eee01852-15ee-4c32-bcaf-b42099fd8f55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:49:35.614429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-eee01852-15ee-4c32-bcaf-b42099fd8f55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for user fd82b48aabbb419cb891867d0b1a57e0 and project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:49:35.627047 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eee01852-15ee-4c32-bcaf-b42099fd8f55 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.186831 Jul 28 03:49:35.628388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 688/1092] 10.222.0.16 () {62 vars in 1199 bytes} [Wed Jul 28 03:49:35 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 189 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jul 28 03:49:36.346067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-42c76a5d-dc11-453e-a99a-671b4bf4554b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:36.347385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-42c76a5d-dc11-453e-a99a-671b4bf4554b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:36.353435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42c76a5d-dc11-453e-a99a-671b4bf4554b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:36.353935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42c76a5d-dc11-453e-a99a-671b4bf4554b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:36.354829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42c76a5d-dc11-453e-a99a-671b4bf4554b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:36.355304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-42c76a5d-dc11-453e-a99a-671b4bf4554b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:36.418672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-42c76a5d-dc11-453e-a99a-671b4bf4554b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:36.426244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-42c76a5d-dc11-453e-a99a-671b4bf4554b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.083885 Jul 28 03:49:36.426790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 689/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:36 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:36.860280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2038381493", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09233d9b-0c94-4f1f-a3bd-45f2d97443e5"}], "security_groups": [{"name": "tempest-securitygroup--1266680379"}], "key_name": "tempest-keypair-1390679599", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:36.953050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] validate_networks() for [('09233d9b-0c94-4f1f-a3bd-45f2d97443e5', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:49:37.367596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:49:37.368199 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:49:37.368513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:49:37.368922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:49:37.369333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:49:37.377823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:37.378275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:37.379076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:37.379547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:37.395848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:49:37.399638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Getting quotas for user fd82b48aabbb419cb891867d0b1a57e0 and project ee20ad097bcc4c51a357aa0a803f59a8. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:49:37.410612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:49:37.412903 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:49:37.460260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-87c2a916-307f-4b70-9af6-51a16f570fc6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.604095 Jul 28 03:49:37.460902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 690/1094] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Jul 28 03:49:36 2021] POST /compute/v2.1/servers => generated 402 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:49:37.465117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f7e46786-606f-4e68-a88f-eef9f7e728b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:37.465788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f7e46786-606f-4e68-a88f-eef9f7e728b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:37.471967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7e46786-606f-4e68-a88f-eef9f7e728b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:37.472412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7e46786-606f-4e68-a88f-eef9f7e728b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:37.473183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7e46786-606f-4e68-a88f-eef9f7e728b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:37.473618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7e46786-606f-4e68-a88f-eef9f7e728b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:37.535332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f7e46786-606f-4e68-a88f-eef9f7e728b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:37.542774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f7e46786-606f-4e68-a88f-eef9f7e728b5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080931 Jul 28 03:49:37.543341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 691/1095] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:37 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:37.547519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f077f4ee-7b3e-4d14-81ae-039f57ebb2ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:37.548144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f077f4ee-7b3e-4d14-81ae-039f57ebb2ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:37.598714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f077f4ee-7b3e-4d14-81ae-039f57ebb2ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:37.605936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f077f4ee-7b3e-4d14-81ae-039f57ebb2ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:37.607458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f077f4ee-7b3e-4d14-81ae-039f57ebb2ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:37.608547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f077f4ee-7b3e-4d14-81ae-039f57ebb2ee tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1282 microversion: 2.20 time: 0.064274 Jul 28 03:49:37.609240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 692/1096] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:37 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1282 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:38.560578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-19c6a170-97ac-443f-861c-8676f0d32b6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:38.561257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-19c6a170-97ac-443f-861c-8676f0d32b6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:38.568053 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19c6a170-97ac-443f-861c-8676f0d32b6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:38.568499 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19c6a170-97ac-443f-861c-8676f0d32b6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:38.569269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19c6a170-97ac-443f-861c-8676f0d32b6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:38.569701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19c6a170-97ac-443f-861c-8676f0d32b6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:38.638881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-19c6a170-97ac-443f-861c-8676f0d32b6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:38.646244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-19c6a170-97ac-443f-861c-8676f0d32b6f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.089272 Jul 28 03:49:38.646800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 693/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:38 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:38.651429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-16fefea2-d2f4-4c68-919c-488eb8f55590 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:38.652229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-16fefea2-d2f4-4c68-919c-488eb8f55590 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:38.659637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16fefea2-d2f4-4c68-919c-488eb8f55590 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:38.660432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16fefea2-d2f4-4c68-919c-488eb8f55590 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:38.661889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16fefea2-d2f4-4c68-919c-488eb8f55590 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:38.662915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-16fefea2-d2f4-4c68-919c-488eb8f55590 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:38.733468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-16fefea2-d2f4-4c68-919c-488eb8f55590 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:38.742116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-16fefea2-d2f4-4c68-919c-488eb8f55590 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:38.743606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-16fefea2-d2f4-4c68-919c-488eb8f55590 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:38.744955 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-16fefea2-d2f4-4c68-919c-488eb8f55590 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1352 microversion: 2.20 time: 0.096832 Jul 28 03:49:38.756021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 694/1098] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:38 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:39.664013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-07a32742-a78b-455a-a140-b71c7cadd06f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:39.664626 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-07a32742-a78b-455a-a140-b71c7cadd06f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:39.670425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07a32742-a78b-455a-a140-b71c7cadd06f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:39.670874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07a32742-a78b-455a-a140-b71c7cadd06f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:39.671645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07a32742-a78b-455a-a140-b71c7cadd06f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:39.672112 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07a32742-a78b-455a-a140-b71c7cadd06f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:39.741676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-07a32742-a78b-455a-a140-b71c7cadd06f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:39.750396 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-07a32742-a78b-455a-a140-b71c7cadd06f tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.090198 Jul 28 03:49:39.751993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 695/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:39 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:39.767724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2f3fcac0-c6ae-4d76-baad-7f8fc3a38345 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:39.769311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2f3fcac0-c6ae-4d76-baad-7f8fc3a38345 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:39.775668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f3fcac0-c6ae-4d76-baad-7f8fc3a38345 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:39.776301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f3fcac0-c6ae-4d76-baad-7f8fc3a38345 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:39.777217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f3fcac0-c6ae-4d76-baad-7f8fc3a38345 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:39.777756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f3fcac0-c6ae-4d76-baad-7f8fc3a38345 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:39.923002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2f3fcac0-c6ae-4d76-baad-7f8fc3a38345 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:39.931640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2f3fcac0-c6ae-4d76-baad-7f8fc3a38345 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:39.933181 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2f3fcac0-c6ae-4d76-baad-7f8fc3a38345 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:39.934808 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2f3fcac0-c6ae-4d76-baad-7f8fc3a38345 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1408 microversion: 2.20 time: 0.172384 Jul 28 03:49:39.935545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 696/1100] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:39 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:39.957473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-5003ae25-8211-4aae-ba64-1cccfbd13854 req-f722198d-ca43-4d48-a8fc-235f89864fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb93149a-aac0-4bcd-af4a-16726ab6d1df", "tag": "4131a892-3af6-42e1-baaf-3d85313cb04d"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:39.959014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:49:39.959014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:49:39.967494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5003ae25-8211-4aae-ba64-1cccfbd13854 req-f722198d-ca43-4d48-a8fc-235f89864fb8 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:39.968089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5003ae25-8211-4aae-ba64-1cccfbd13854 req-f722198d-ca43-4d48-a8fc-235f89864fb8 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:39.982550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-5003ae25-8211-4aae-ba64-1cccfbd13854 req-f722198d-ca43-4d48-a8fc-235f89864fb8 service nova] Creating event network-changed:4131a892-3af6-42e1-baaf-3d85313cb04d for instance fb93149a-aac0-4bcd-af4a-16726ab6d1df on hv-cinder-73306 Jul 28 03:49:39.987782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-5003ae25-8211-4aae-ba64-1cccfbd13854 req-f722198d-ca43-4d48-a8fc-235f89864fb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035167 Jul 28 03:49:39.988742 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 697/1101] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:49:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:49:40.769263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9c351142-2527-4d50-b0ee-7489972a73a9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:40.769881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9c351142-2527-4d50-b0ee-7489972a73a9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:40.775691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c351142-2527-4d50-b0ee-7489972a73a9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:40.776167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c351142-2527-4d50-b0ee-7489972a73a9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:40.776932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c351142-2527-4d50-b0ee-7489972a73a9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:40.777365 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9c351142-2527-4d50-b0ee-7489972a73a9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:40.838662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9c351142-2527-4d50-b0ee-7489972a73a9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:40.848437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9c351142-2527-4d50-b0ee-7489972a73a9 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.083367 Jul 28 03:49:40.849045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 698/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:40 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:40.954173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7a4e5895-9998-40f0-afb4-2c783ac3a6fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:40.954803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7a4e5895-9998-40f0-afb4-2c783ac3a6fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:40.960832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a4e5895-9998-40f0-afb4-2c783ac3a6fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:40.961286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a4e5895-9998-40f0-afb4-2c783ac3a6fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:40.962057 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a4e5895-9998-40f0-afb4-2c783ac3a6fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:40.962493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a4e5895-9998-40f0-afb4-2c783ac3a6fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:41.085142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7a4e5895-9998-40f0-afb4-2c783ac3a6fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:41.092743 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7a4e5895-9998-40f0-afb4-2c783ac3a6fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:41.094244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7a4e5895-9998-40f0-afb4-2c783ac3a6fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:41.095300 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7a4e5895-9998-40f0-afb4-2c783ac3a6fe tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1408 microversion: 2.20 time: 0.144971 Jul 28 03:49:41.095867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 699/1103] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:40 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:41.865512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-19ddbe46-ae4c-4f20-b4cc-eba940722ce4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:41.866122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-19ddbe46-ae4c-4f20-b4cc-eba940722ce4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:41.872095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19ddbe46-ae4c-4f20-b4cc-eba940722ce4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:41.872540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19ddbe46-ae4c-4f20-b4cc-eba940722ce4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:41.873332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19ddbe46-ae4c-4f20-b4cc-eba940722ce4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:41.873763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19ddbe46-ae4c-4f20-b4cc-eba940722ce4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:41.935689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-19ddbe46-ae4c-4f20-b4cc-eba940722ce4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:41.944283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-19ddbe46-ae4c-4f20-b4cc-eba940722ce4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.082564 Jul 28 03:49:41.944724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 700/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:41 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:42.113178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1cba71dc-dded-4527-b507-8754fe4ff617 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:42.113782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1cba71dc-dded-4527-b507-8754fe4ff617 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:42.119874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1cba71dc-dded-4527-b507-8754fe4ff617 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:42.120251 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1cba71dc-dded-4527-b507-8754fe4ff617 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:42.121013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1cba71dc-dded-4527-b507-8754fe4ff617 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:42.121610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1cba71dc-dded-4527-b507-8754fe4ff617 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:42.249507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1cba71dc-dded-4527-b507-8754fe4ff617 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:42.257191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1cba71dc-dded-4527-b507-8754fe4ff617 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:42.258733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1cba71dc-dded-4527-b507-8754fe4ff617 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:42.259827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1cba71dc-dded-4527-b507-8754fe4ff617 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1408 microversion: 2.20 time: 0.150588 Jul 28 03:49:42.260366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 701/1105] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:42 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:42.960759 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-619d2884-1b6f-46f6-aa71-4a9817e6de53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:42.961431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-619d2884-1b6f-46f6-aa71-4a9817e6de53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:42.967007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-619d2884-1b6f-46f6-aa71-4a9817e6de53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:42.967448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-619d2884-1b6f-46f6-aa71-4a9817e6de53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:42.968236 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-619d2884-1b6f-46f6-aa71-4a9817e6de53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:42.968664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-619d2884-1b6f-46f6-aa71-4a9817e6de53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:43.029970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-619d2884-1b6f-46f6-aa71-4a9817e6de53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:43.037428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-619d2884-1b6f-46f6-aa71-4a9817e6de53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080278 Jul 28 03:49:43.037982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 702/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:42 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:43.277450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-32e2a5ca-7ea2-47e0-a3c9-450ae7bcf116 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:43.278066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-32e2a5ca-7ea2-47e0-a3c9-450ae7bcf116 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:43.284240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32e2a5ca-7ea2-47e0-a3c9-450ae7bcf116 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:43.284781 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32e2a5ca-7ea2-47e0-a3c9-450ae7bcf116 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:43.285556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32e2a5ca-7ea2-47e0-a3c9-450ae7bcf116 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:43.285993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-32e2a5ca-7ea2-47e0-a3c9-450ae7bcf116 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:43.404351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-32e2a5ca-7ea2-47e0-a3c9-450ae7bcf116 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:43.412528 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-32e2a5ca-7ea2-47e0-a3c9-450ae7bcf116 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:43.414010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-32e2a5ca-7ea2-47e0-a3c9-450ae7bcf116 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:43.415082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-32e2a5ca-7ea2-47e0-a3c9-450ae7bcf116 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1408 microversion: 2.20 time: 0.141250 Jul 28 03:49:43.415631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 703/1107] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:43 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:44.054066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-788fae22-5aeb-4b27-9848-179391f051b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:44.054710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-788fae22-5aeb-4b27-9848-179391f051b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:44.060627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-788fae22-5aeb-4b27-9848-179391f051b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:44.061076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-788fae22-5aeb-4b27-9848-179391f051b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:44.061835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-788fae22-5aeb-4b27-9848-179391f051b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:44.062274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-788fae22-5aeb-4b27-9848-179391f051b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:44.121773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-788fae22-5aeb-4b27-9848-179391f051b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:44.129648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-788fae22-5aeb-4b27-9848-179391f051b1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079194 Jul 28 03:49:44.130201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 704/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:44 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:44.433206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f5be2bd9-c4c5-43bb-971a-dc6d453b9a26 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:44.433817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f5be2bd9-c4c5-43bb-971a-dc6d453b9a26 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:44.439552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5be2bd9-c4c5-43bb-971a-dc6d453b9a26 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:44.440676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5be2bd9-c4c5-43bb-971a-dc6d453b9a26 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:44.441466 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5be2bd9-c4c5-43bb-971a-dc6d453b9a26 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:44.441900 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5be2bd9-c4c5-43bb-971a-dc6d453b9a26 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:44.557581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f5be2bd9-c4c5-43bb-971a-dc6d453b9a26 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:44.565995 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f5be2bd9-c4c5-43bb-971a-dc6d453b9a26 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:44.567438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f5be2bd9-c4c5-43bb-971a-dc6d453b9a26 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:44.568560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f5be2bd9-c4c5-43bb-971a-dc6d453b9a26 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1408 microversion: 2.20 time: 0.139150 Jul 28 03:49:44.569085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 705/1109] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:44 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1408 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:45.146616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-824a3a7c-8ae2-456f-b6ca-5aff3bada642 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:45.147221 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-824a3a7c-8ae2-456f-b6ca-5aff3bada642 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:45.152788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-824a3a7c-8ae2-456f-b6ca-5aff3bada642 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:45.153237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-824a3a7c-8ae2-456f-b6ca-5aff3bada642 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:45.154010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-824a3a7c-8ae2-456f-b6ca-5aff3bada642 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:45.154443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-824a3a7c-8ae2-456f-b6ca-5aff3bada642 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:45.218974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-824a3a7c-8ae2-456f-b6ca-5aff3bada642 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:45.227363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-824a3a7c-8ae2-456f-b6ca-5aff3bada642 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.084908 Jul 28 03:49:45.228152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 706/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:45 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:45.586469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8f26c3f7-5c1b-4712-af3f-2213467a5a87 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:45.587077 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8f26c3f7-5c1b-4712-af3f-2213467a5a87 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:45.592972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f26c3f7-5c1b-4712-af3f-2213467a5a87 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:45.593420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f26c3f7-5c1b-4712-af3f-2213467a5a87 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:45.594182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f26c3f7-5c1b-4712-af3f-2213467a5a87 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:45.594613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f26c3f7-5c1b-4712-af3f-2213467a5a87 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:45.712725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8f26c3f7-5c1b-4712-af3f-2213467a5a87 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:45.720292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8f26c3f7-5c1b-4712-af3f-2213467a5a87 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:45.721806 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8f26c3f7-5c1b-4712-af3f-2213467a5a87 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:45.722880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8f26c3f7-5c1b-4712-af3f-2213467a5a87 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1408 microversion: 2.20 time: 0.140140 Jul 28 03:49:45.723469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 707/1111] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:45 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:46.244383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a80d5284-6320-488e-93cf-4366443369d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:46.245067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a80d5284-6320-488e-93cf-4366443369d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:46.250997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a80d5284-6320-488e-93cf-4366443369d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:46.251442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a80d5284-6320-488e-93cf-4366443369d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:46.252885 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a80d5284-6320-488e-93cf-4366443369d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:46.253342 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a80d5284-6320-488e-93cf-4366443369d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:46.313607 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a80d5284-6320-488e-93cf-4366443369d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:46.321314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a80d5284-6320-488e-93cf-4366443369d3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080539 Jul 28 03:49:46.321880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 708/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:46 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:46.740504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a8860937-6036-4948-a1df-5745e5824121 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:46.741014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a8860937-6036-4948-a1df-5745e5824121 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:46.747336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a8860937-6036-4948-a1df-5745e5824121 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:46.747982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a8860937-6036-4948-a1df-5745e5824121 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:46.748746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a8860937-6036-4948-a1df-5745e5824121 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:46.749488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a8860937-6036-4948-a1df-5745e5824121 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:46.871051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a8860937-6036-4948-a1df-5745e5824121 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:46.879259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a8860937-6036-4948-a1df-5745e5824121 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:46.880802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a8860937-6036-4948-a1df-5745e5824121 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:46.881906 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a8860937-6036-4948-a1df-5745e5824121 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1408 microversion: 2.20 time: 0.145106 Jul 28 03:49:46.882679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 709/1113] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:46 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:46.964734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-75aef78d-7444-460f-9e6a-9a44e71b5bd6 req-339555b7-6771-486d-938c-21a60d47b9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb93149a-aac0-4bcd-af4a-16726ab6d1df", "name": "network-vif-plugged", "status": "completed", "tag": "4131a892-3af6-42e1-baaf-3d85313cb04d"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:46.966350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:49:46.966350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:49:46.973956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-75aef78d-7444-460f-9e6a-9a44e71b5bd6 req-339555b7-6771-486d-938c-21a60d47b9fe service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:46.974649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-75aef78d-7444-460f-9e6a-9a44e71b5bd6 req-339555b7-6771-486d-938c-21a60d47b9fe service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:46.985187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-75aef78d-7444-460f-9e6a-9a44e71b5bd6 req-339555b7-6771-486d-938c-21a60d47b9fe service nova] Creating event network-vif-plugged:4131a892-3af6-42e1-baaf-3d85313cb04d for instance fb93149a-aac0-4bcd-af4a-16726ab6d1df on hv-cinder-73306 Jul 28 03:49:46.990195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-75aef78d-7444-460f-9e6a-9a44e71b5bd6 req-339555b7-6771-486d-938c-21a60d47b9fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082604 Jul 28 03:49:46.990811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 710/1114] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:49:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:49:47.338493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-06d5c8e7-9354-4345-865b-270e7a7918e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:47.339285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-06d5c8e7-9354-4345-865b-270e7a7918e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:47.345284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06d5c8e7-9354-4345-865b-270e7a7918e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:47.345726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06d5c8e7-9354-4345-865b-270e7a7918e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:47.346531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06d5c8e7-9354-4345-865b-270e7a7918e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:47.346959 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06d5c8e7-9354-4345-865b-270e7a7918e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:47.406111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-06d5c8e7-9354-4345-865b-270e7a7918e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:47.413229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-06d5c8e7-9354-4345-865b-270e7a7918e8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078651 Jul 28 03:49:47.413778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 711/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:47 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:47.899379 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6ffe891b-a2a7-407a-b598-63fda5162f8c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:47.900003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6ffe891b-a2a7-407a-b598-63fda5162f8c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:47.905808 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ffe891b-a2a7-407a-b598-63fda5162f8c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:47.906253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ffe891b-a2a7-407a-b598-63fda5162f8c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:47.907016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ffe891b-a2a7-407a-b598-63fda5162f8c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:47.907446 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ffe891b-a2a7-407a-b598-63fda5162f8c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:48.027226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6ffe891b-a2a7-407a-b598-63fda5162f8c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:48.035315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6ffe891b-a2a7-407a-b598-63fda5162f8c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:48.036817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6ffe891b-a2a7-407a-b598-63fda5162f8c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:48.037870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6ffe891b-a2a7-407a-b598-63fda5162f8c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1408 microversion: 2.20 time: 0.142263 Jul 28 03:49:48.038415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 712/1116] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:47 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:48.429669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ca1f3f5e-0683-4ef2-ac6b-5edd8e81733e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:48.430286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ca1f3f5e-0683-4ef2-ac6b-5edd8e81733e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:48.436057 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca1f3f5e-0683-4ef2-ac6b-5edd8e81733e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:48.436507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca1f3f5e-0683-4ef2-ac6b-5edd8e81733e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:48.437269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca1f3f5e-0683-4ef2-ac6b-5edd8e81733e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:48.437704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca1f3f5e-0683-4ef2-ac6b-5edd8e81733e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:48.496127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ca1f3f5e-0683-4ef2-ac6b-5edd8e81733e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:48.503270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ca1f3f5e-0683-4ef2-ac6b-5edd8e81733e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077213 Jul 28 03:49:48.507858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 713/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:48 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:49.055876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0689d8d4-dc1f-44ff-9e56-21bf28354719 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:49.056485 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0689d8d4-dc1f-44ff-9e56-21bf28354719 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:49.062283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0689d8d4-dc1f-44ff-9e56-21bf28354719 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:49.062737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0689d8d4-dc1f-44ff-9e56-21bf28354719 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:49.063513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0689d8d4-dc1f-44ff-9e56-21bf28354719 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:49.063979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0689d8d4-dc1f-44ff-9e56-21bf28354719 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:49.185165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0689d8d4-dc1f-44ff-9e56-21bf28354719 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:49.193543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0689d8d4-dc1f-44ff-9e56-21bf28354719 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:49.195037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0689d8d4-dc1f-44ff-9e56-21bf28354719 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:49.196202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0689d8d4-dc1f-44ff-9e56-21bf28354719 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1599 microversion: 2.20 time: 0.144044 Jul 28 03:49:49.196749 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 714/1118] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:49:49 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1599 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:49.212531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-38565339-7c88-4b06-a471-7154101e99f7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:49.213020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-38565339-7c88-4b06-a471-7154101e99f7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:49.218428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38565339-7c88-4b06-a471-7154101e99f7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:49.218875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38565339-7c88-4b06-a471-7154101e99f7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:49.219633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38565339-7c88-4b06-a471-7154101e99f7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:49.220092 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38565339-7c88-4b06-a471-7154101e99f7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:49.297884 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-38565339-7c88-4b06-a471-7154101e99f7 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088628 Jul 28 03:49:49.298469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 715/1119] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Jul 28 03:49:49 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:49:49.520781 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-93ea4f97-7edf-49c3-a22c-0058c0e791f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:49.521483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-93ea4f97-7edf-49c3-a22c-0058c0e791f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:49.527525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93ea4f97-7edf-49c3-a22c-0058c0e791f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:49.528003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93ea4f97-7edf-49c3-a22c-0058c0e791f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:49.528780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93ea4f97-7edf-49c3-a22c-0058c0e791f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:49.529208 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93ea4f97-7edf-49c3-a22c-0058c0e791f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:49.650230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-93ea4f97-7edf-49c3-a22c-0058c0e791f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:49.657432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-93ea4f97-7edf-49c3-a22c-0058c0e791f8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.141148 Jul 28 03:49:49.657984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 716/1120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:49 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:50.466820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c4db7c2a-1d63-437c-86a8-5b6a489e8c5d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:50.468017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c4db7c2a-1d63-437c-86a8-5b6a489e8c5d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:50.477289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c4db7c2a-1d63-437c-86a8-5b6a489e8c5d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:50.477839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c4db7c2a-1d63-437c-86a8-5b6a489e8c5d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:50.478823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c4db7c2a-1d63-437c-86a8-5b6a489e8c5d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:50.480729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c4db7c2a-1d63-437c-86a8-5b6a489e8c5d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:50.589237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c4db7c2a-1d63-437c-86a8-5b6a489e8c5d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 14 microversion: 2.20 time: 0.126677 Jul 28 03:49:50.592567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 717/1121] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:49:50 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:50.594803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-28c00c66-7df3-46f6-9b18-5ee9dba4e0e8 req-657a62b0-e75e-4057-bb55-8d0e4a8460d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb93149a-aac0-4bcd-af4a-16726ab6d1df", "tag": "4131a892-3af6-42e1-baaf-3d85313cb04d"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:50.596402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:49:50.596402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:49:50.604174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-28c00c66-7df3-46f6-9b18-5ee9dba4e0e8 req-657a62b0-e75e-4057-bb55-8d0e4a8460d1 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:50.604614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-28c00c66-7df3-46f6-9b18-5ee9dba4e0e8 req-657a62b0-e75e-4057-bb55-8d0e4a8460d1 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:50.615636 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-28c00c66-7df3-46f6-9b18-5ee9dba4e0e8 req-657a62b0-e75e-4057-bb55-8d0e4a8460d1 service nova] Creating event network-changed:4131a892-3af6-42e1-baaf-3d85313cb04d for instance fb93149a-aac0-4bcd-af4a-16726ab6d1df on hv-cinder-73306 Jul 28 03:49:50.620555 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-28c00c66-7df3-46f6-9b18-5ee9dba4e0e8 req-657a62b0-e75e-4057-bb55-8d0e4a8460d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029254 Jul 28 03:49:50.621149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 718/1122] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:49:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:50.679464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2b38253c-37d1-4d4d-a8b3-22599d2ce5dd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:50.680189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2b38253c-37d1-4d4d-a8b3-22599d2ce5dd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:50.686149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b38253c-37d1-4d4d-a8b3-22599d2ce5dd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:50.686818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b38253c-37d1-4d4d-a8b3-22599d2ce5dd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:50.687587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b38253c-37d1-4d4d-a8b3-22599d2ce5dd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:50.688192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2b38253c-37d1-4d4d-a8b3-22599d2ce5dd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:50.754936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2b38253c-37d1-4d4d-a8b3-22599d2ce5dd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:50.762668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2b38253c-37d1-4d4d-a8b3-22599d2ce5dd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.087667 Jul 28 03:49:50.763222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 719/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:50 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:51.600408 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f4864bb3-95cf-4125-a797-5373e93f8fae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:51.601371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f4864bb3-95cf-4125-a797-5373e93f8fae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:51.607488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4864bb3-95cf-4125-a797-5373e93f8fae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:51.607972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4864bb3-95cf-4125-a797-5373e93f8fae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:51.608737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4864bb3-95cf-4125-a797-5373e93f8fae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:51.609173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f4864bb3-95cf-4125-a797-5373e93f8fae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:51.687692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f4864bb3-95cf-4125-a797-5373e93f8fae tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 14 microversion: 2.20 time: 0.091201 Jul 28 03:49:51.688316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 720/1124] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:49:51 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:51.780017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e21374ce-37bf-450b-8bfa-9c44142bcea3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:51.780711 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e21374ce-37bf-450b-8bfa-9c44142bcea3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:51.787100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e21374ce-37bf-450b-8bfa-9c44142bcea3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:51.787535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e21374ce-37bf-450b-8bfa-9c44142bcea3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:51.788370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e21374ce-37bf-450b-8bfa-9c44142bcea3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:51.788800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e21374ce-37bf-450b-8bfa-9c44142bcea3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:51.848468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e21374ce-37bf-450b-8bfa-9c44142bcea3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:51.855873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e21374ce-37bf-450b-8bfa-9c44142bcea3 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079832 Jul 28 03:49:51.856422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 721/1125] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:51 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:52.698955 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cd590ff1-088f-44d4-82f2-8589a0ddf492 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:52.699851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cd590ff1-088f-44d4-82f2-8589a0ddf492 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:52.706116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd590ff1-088f-44d4-82f2-8589a0ddf492 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:52.706637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd590ff1-088f-44d4-82f2-8589a0ddf492 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:52.707391 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd590ff1-088f-44d4-82f2-8589a0ddf492 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:52.707851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd590ff1-088f-44d4-82f2-8589a0ddf492 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:52.788623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cd590ff1-088f-44d4-82f2-8589a0ddf492 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 14 microversion: 2.20 time: 0.093152 Jul 28 03:49:52.789362 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 722/1126] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:49:52 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:52.873386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-35e4c5b5-8b64-4d4b-a315-7988cb1e40bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:52.874075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-35e4c5b5-8b64-4d4b-a315-7988cb1e40bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:52.880548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-35e4c5b5-8b64-4d4b-a315-7988cb1e40bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:52.880995 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-35e4c5b5-8b64-4d4b-a315-7988cb1e40bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:52.881746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-35e4c5b5-8b64-4d4b-a315-7988cb1e40bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:52.882174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-35e4c5b5-8b64-4d4b-a315-7988cb1e40bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:52.941260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-35e4c5b5-8b64-4d4b-a315-7988cb1e40bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:52.948346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-35e4c5b5-8b64-4d4b-a315-7988cb1e40bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078854 Jul 28 03:49:52.948888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 723/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:52 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:53.798494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6930542d-068b-458f-a558-4ed01f46c2ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:53.800035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6930542d-068b-458f-a558-4ed01f46c2ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:53.805935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6930542d-068b-458f-a558-4ed01f46c2ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:53.806411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6930542d-068b-458f-a558-4ed01f46c2ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:53.807232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6930542d-068b-458f-a558-4ed01f46c2ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:53.807684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6930542d-068b-458f-a558-4ed01f46c2ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:53.885464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6930542d-068b-458f-a558-4ed01f46c2ed tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 14 microversion: 2.20 time: 0.090462 Jul 28 03:49:53.886084 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 724/1128] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:49:53 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:53.966260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6ba83c48-2990-4d29-bf31-c161eaa38da8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:53.966960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6ba83c48-2990-4d29-bf31-c161eaa38da8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:53.974143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ba83c48-2990-4d29-bf31-c161eaa38da8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:53.974850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ba83c48-2990-4d29-bf31-c161eaa38da8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:53.975629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ba83c48-2990-4d29-bf31-c161eaa38da8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:53.976103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ba83c48-2990-4d29-bf31-c161eaa38da8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:54.035615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6ba83c48-2990-4d29-bf31-c161eaa38da8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:54.042819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6ba83c48-2990-4d29-bf31-c161eaa38da8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080572 Jul 28 03:49:54.043371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 725/1129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:53 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:54.896605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-45265ec1-24d9-438f-8058-05a6c8cdf54f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:54.897726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-45265ec1-24d9-438f-8058-05a6c8cdf54f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:54.903376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45265ec1-24d9-438f-8058-05a6c8cdf54f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:54.903868 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45265ec1-24d9-438f-8058-05a6c8cdf54f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:54.904644 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45265ec1-24d9-438f-8058-05a6c8cdf54f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:54.905078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-45265ec1-24d9-438f-8058-05a6c8cdf54f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:54.985267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-45265ec1-24d9-438f-8058-05a6c8cdf54f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 14 microversion: 2.20 time: 0.092899 Jul 28 03:49:54.985865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 726/1130] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:49:54 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:55.060658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b2821194-df11-472a-bc28-8737f2ecee19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:55.061407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b2821194-df11-472a-bc28-8737f2ecee19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:55.068510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2821194-df11-472a-bc28-8737f2ecee19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:55.068963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2821194-df11-472a-bc28-8737f2ecee19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:55.069719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2821194-df11-472a-bc28-8737f2ecee19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:55.070152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2821194-df11-472a-bc28-8737f2ecee19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:55.129932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b2821194-df11-472a-bc28-8737f2ecee19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:55.137221 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b2821194-df11-472a-bc28-8737f2ecee19 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080506 Jul 28 03:49:55.137720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 727/1131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:55 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:55.999611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bfe30516-e542-4860-9658-4c5ff328601a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:56.000553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bfe30516-e542-4860-9658-4c5ff328601a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:56.006745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bfe30516-e542-4860-9658-4c5ff328601a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:56.007262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bfe30516-e542-4860-9658-4c5ff328601a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:56.008170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bfe30516-e542-4860-9658-4c5ff328601a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:56.008668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bfe30516-e542-4860-9658-4c5ff328601a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:56.088370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bfe30516-e542-4860-9658-4c5ff328601a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 14 microversion: 2.20 time: 0.092305 Jul 28 03:49:56.088962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 728/1132] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:49:55 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:56.154132 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0d72d9fd-4290-4113-8082-f6be7bd82ad5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:56.154821 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0d72d9fd-4290-4113-8082-f6be7bd82ad5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:56.161611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d72d9fd-4290-4113-8082-f6be7bd82ad5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:56.162049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d72d9fd-4290-4113-8082-f6be7bd82ad5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:56.162808 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d72d9fd-4290-4113-8082-f6be7bd82ad5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:56.163238 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d72d9fd-4290-4113-8082-f6be7bd82ad5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:56.227698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0d72d9fd-4290-4113-8082-f6be7bd82ad5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:56.235004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0d72d9fd-4290-4113-8082-f6be7bd82ad5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.084715 Jul 28 03:49:56.235553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 729/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:56 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:57.100071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6989dfe0-e23d-46c1-882a-f634937e2966 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:57.101018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6989dfe0-e23d-46c1-882a-f634937e2966 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:57.106697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6989dfe0-e23d-46c1-882a-f634937e2966 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:57.107178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6989dfe0-e23d-46c1-882a-f634937e2966 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:57.107964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6989dfe0-e23d-46c1-882a-f634937e2966 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:57.108396 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6989dfe0-e23d-46c1-882a-f634937e2966 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:57.198308 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6989dfe0-e23d-46c1-882a-f634937e2966 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 14 microversion: 2.20 time: 0.102468 Jul 28 03:49:57.198917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 730/1134] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:49:57 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:57.251752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-af6671cd-112f-4d82-a3a5-b06734cab806 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:57.252407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-af6671cd-112f-4d82-a3a5-b06734cab806 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:57.258837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af6671cd-112f-4d82-a3a5-b06734cab806 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:57.259287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af6671cd-112f-4d82-a3a5-b06734cab806 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:57.260082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af6671cd-112f-4d82-a3a5-b06734cab806 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:57.260519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af6671cd-112f-4d82-a3a5-b06734cab806 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:57.320889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-af6671cd-112f-4d82-a3a5-b06734cab806 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:57.328015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-af6671cd-112f-4d82-a3a5-b06734cab806 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080020 Jul 28 03:49:57.328562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 731/1135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:57 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:58.209223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1de9e707-060a-4691-a651-e565ac80426c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:58.210135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1de9e707-060a-4691-a651-e565ac80426c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:58.216034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1de9e707-060a-4691-a651-e565ac80426c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:58.216485 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1de9e707-060a-4691-a651-e565ac80426c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:58.217246 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1de9e707-060a-4691-a651-e565ac80426c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:58.217682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1de9e707-060a-4691-a651-e565ac80426c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:58.303616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1de9e707-060a-4691-a651-e565ac80426c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 14 microversion: 2.20 time: 0.098016 Jul 28 03:49:58.304263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 732/1136] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:49:58 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:58.345269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-abc79f83-071e-440a-ac68-e50255b2f8ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:58.345961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-abc79f83-071e-440a-ac68-e50255b2f8ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:58.353056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-abc79f83-071e-440a-ac68-e50255b2f8ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:58.353509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-abc79f83-071e-440a-ac68-e50255b2f8ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:58.354268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-abc79f83-071e-440a-ac68-e50255b2f8ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:58.354701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-abc79f83-071e-440a-ac68-e50255b2f8ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:58.414608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-abc79f83-071e-440a-ac68-e50255b2f8ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:58.421761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-abc79f83-071e-440a-ac68-e50255b2f8ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080147 Jul 28 03:49:58.422307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 733/1137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:58 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:59.313648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-25a6f095-52e1-493c-9d68-14f50dd9e010 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:59.314580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-25a6f095-52e1-493c-9d68-14f50dd9e010 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:59.320973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25a6f095-52e1-493c-9d68-14f50dd9e010 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:59.321424 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25a6f095-52e1-493c-9d68-14f50dd9e010 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:59.322226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25a6f095-52e1-493c-9d68-14f50dd9e010 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:59.322656 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25a6f095-52e1-493c-9d68-14f50dd9e010 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:59.404077 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-25a6f095-52e1-493c-9d68-14f50dd9e010 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 14 microversion: 2.20 time: 0.093855 Jul 28 03:49:59.404589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 734/1138] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:49:59 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:59.438796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-975149ed-d6d9-4a7b-aee4-6d4d1800a084 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:59.439482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-975149ed-d6d9-4a7b-aee4-6d4d1800a084 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:49:59.446195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-975149ed-d6d9-4a7b-aee4-6d4d1800a084 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:59.446639 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-975149ed-d6d9-4a7b-aee4-6d4d1800a084 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:59.447396 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-975149ed-d6d9-4a7b-aee4-6d4d1800a084 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:49:59.447918 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-975149ed-d6d9-4a7b-aee4-6d4d1800a084 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:49:59.509462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-975149ed-d6d9-4a7b-aee4-6d4d1800a084 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:59.516757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-975149ed-d6d9-4a7b-aee4-6d4d1800a084 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.081565 Jul 28 03:49:59.517299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 735/1139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:49:59 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:00.414499 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-843e0bcb-6035-454a-bc99-9789186cb60e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:00.415343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-843e0bcb-6035-454a-bc99-9789186cb60e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:00.421211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-843e0bcb-6035-454a-bc99-9789186cb60e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:00.421664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-843e0bcb-6035-454a-bc99-9789186cb60e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:00.422438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-843e0bcb-6035-454a-bc99-9789186cb60e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:00.422878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-843e0bcb-6035-454a-bc99-9789186cb60e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:00.527683 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-843e0bcb-6035-454a-bc99-9789186cb60e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 11371 microversion: 2.20 time: 0.116812 Jul 28 03:50:00.528340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 736/1140] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:00 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 11371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:00.534405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e5c71cbd-9b5f-47ce-a0c0-d7566a2bb3bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:00.535111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e5c71cbd-9b5f-47ce-a0c0-d7566a2bb3bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:00.541486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e5c71cbd-9b5f-47ce-a0c0-d7566a2bb3bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:00.541941 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e5c71cbd-9b5f-47ce-a0c0-d7566a2bb3bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:00.542709 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e5c71cbd-9b5f-47ce-a0c0-d7566a2bb3bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:00.543147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e5c71cbd-9b5f-47ce-a0c0-d7566a2bb3bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:00.605031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e5c71cbd-9b5f-47ce-a0c0-d7566a2bb3bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:00.612875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e5c71cbd-9b5f-47ce-a0c0-d7566a2bb3bd tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.082689 Jul 28 03:50:00.613500 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 737/1141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:00 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:01.539333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c3d99b0d-4521-4a90-9651-8238b4b545c2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:01.540206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c3d99b0d-4521-4a90-9651-8238b4b545c2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:01.546368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3d99b0d-4521-4a90-9651-8238b4b545c2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:01.546812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3d99b0d-4521-4a90-9651-8238b4b545c2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:01.547572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3d99b0d-4521-4a90-9651-8238b4b545c2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:01.548029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3d99b0d-4521-4a90-9651-8238b4b545c2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:01.641686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c3d99b0d-4521-4a90-9651-8238b4b545c2 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 18608 microversion: 2.20 time: 0.105960 Jul 28 03:50:01.642300 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 738/1142] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:01 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 18608 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:01.647695 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7a81e255-5971-47df-8dcd-80d10c4148fc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:01.648405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7a81e255-5971-47df-8dcd-80d10c4148fc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:01.654611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a81e255-5971-47df-8dcd-80d10c4148fc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:01.655057 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a81e255-5971-47df-8dcd-80d10c4148fc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:01.655927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a81e255-5971-47df-8dcd-80d10c4148fc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:01.656368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a81e255-5971-47df-8dcd-80d10c4148fc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:01.715129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7a81e255-5971-47df-8dcd-80d10c4148fc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:01.722993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7a81e255-5971-47df-8dcd-80d10c4148fc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078947 Jul 28 03:50:01.723550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 739/1143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:01 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:02.653581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9ef6b4bf-2b42-4862-b769-55107cdc721f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:02.654500 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9ef6b4bf-2b42-4862-b769-55107cdc721f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:02.660986 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef6b4bf-2b42-4862-b769-55107cdc721f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:02.661438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef6b4bf-2b42-4862-b769-55107cdc721f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:02.662204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef6b4bf-2b42-4862-b769-55107cdc721f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:02.662639 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9ef6b4bf-2b42-4862-b769-55107cdc721f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:02.748075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9ef6b4bf-2b42-4862-b769-55107cdc721f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 19342 microversion: 2.20 time: 0.097992 Jul 28 03:50:02.748684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 740/1144] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:02 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 19342 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:02.754423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-acbaad39-bb21-42c7-8390-001429794421 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:02.755102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-acbaad39-bb21-42c7-8390-001429794421 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:02.761275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-acbaad39-bb21-42c7-8390-001429794421 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:02.761745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-acbaad39-bb21-42c7-8390-001429794421 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:02.762506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-acbaad39-bb21-42c7-8390-001429794421 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:02.762933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-acbaad39-bb21-42c7-8390-001429794421 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:02.826372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-acbaad39-bb21-42c7-8390-001429794421 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:02.833774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-acbaad39-bb21-42c7-8390-001429794421 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.084025 Jul 28 03:50:02.834324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 741/1145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:02 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:03.759840 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f70a837c-065a-431f-9745-e6d8919e5626 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:03.760671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f70a837c-065a-431f-9745-e6d8919e5626 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:03.766928 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f70a837c-065a-431f-9745-e6d8919e5626 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:03.767373 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f70a837c-065a-431f-9745-e6d8919e5626 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:03.768167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f70a837c-065a-431f-9745-e6d8919e5626 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:03.769207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f70a837c-065a-431f-9745-e6d8919e5626 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:03.855334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f70a837c-065a-431f-9745-e6d8919e5626 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 22021 microversion: 2.20 time: 0.099114 Jul 28 03:50:03.855989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 742/1146] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:03 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 22021 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:03.860626 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a2d271c8-d8be-453a-a94b-06ac484e5b53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:03.861311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a2d271c8-d8be-453a-a94b-06ac484e5b53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:03.867577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a2d271c8-d8be-453a-a94b-06ac484e5b53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:03.868062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a2d271c8-d8be-453a-a94b-06ac484e5b53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:03.868823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a2d271c8-d8be-453a-a94b-06ac484e5b53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:03.869256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a2d271c8-d8be-453a-a94b-06ac484e5b53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:03.928562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a2d271c8-d8be-453a-a94b-06ac484e5b53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:03.935715 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a2d271c8-d8be-453a-a94b-06ac484e5b53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078635 Jul 28 03:50:03.936271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 743/1147] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:03 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:04.866755 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8026b909-5833-4fd0-90e5-69a35c37c679 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:04.867700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8026b909-5833-4fd0-90e5-69a35c37c679 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:04.873580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8026b909-5833-4fd0-90e5-69a35c37c679 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:04.874024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8026b909-5833-4fd0-90e5-69a35c37c679 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:04.874922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8026b909-5833-4fd0-90e5-69a35c37c679 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:04.875221 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8026b909-5833-4fd0-90e5-69a35c37c679 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:04.964155 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8026b909-5833-4fd0-90e5-69a35c37c679 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 23235 microversion: 2.20 time: 0.101053 Jul 28 03:50:04.964766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 744/1148] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:04 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 23235 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:04.969380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c1aec7fb-8db4-4fbd-b001-9d910e5ab005 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:04.970071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c1aec7fb-8db4-4fbd-b001-9d910e5ab005 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:04.977253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1aec7fb-8db4-4fbd-b001-9d910e5ab005 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:04.977699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1aec7fb-8db4-4fbd-b001-9d910e5ab005 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:04.978462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1aec7fb-8db4-4fbd-b001-9d910e5ab005 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:04.978894 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1aec7fb-8db4-4fbd-b001-9d910e5ab005 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:05.038668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c1aec7fb-8db4-4fbd-b001-9d910e5ab005 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:05.045879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c1aec7fb-8db4-4fbd-b001-9d910e5ab005 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080013 Jul 28 03:50:05.046435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 745/1149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:04 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:05.976452 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-242ac77c-a01d-4893-8d6d-f0ad889e543c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:05.977365 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-242ac77c-a01d-4893-8d6d-f0ad889e543c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:05.983532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-242ac77c-a01d-4893-8d6d-f0ad889e543c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:05.984003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-242ac77c-a01d-4893-8d6d-f0ad889e543c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:05.984757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-242ac77c-a01d-4893-8d6d-f0ad889e543c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:05.985182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-242ac77c-a01d-4893-8d6d-f0ad889e543c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:06.073003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-242ac77c-a01d-4893-8d6d-f0ad889e543c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 25095 microversion: 2.20 time: 0.101094 Jul 28 03:50:06.073605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 746/1150] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:05 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 25095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:06.078347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-aca21a2e-b66c-4adf-8fbb-1f34b1b260b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:06.079030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-aca21a2e-b66c-4adf-8fbb-1f34b1b260b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:06.085284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aca21a2e-b66c-4adf-8fbb-1f34b1b260b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:06.085721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aca21a2e-b66c-4adf-8fbb-1f34b1b260b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:06.086468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aca21a2e-b66c-4adf-8fbb-1f34b1b260b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:06.086895 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aca21a2e-b66c-4adf-8fbb-1f34b1b260b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:06.147263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-aca21a2e-b66c-4adf-8fbb-1f34b1b260b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:06.154491 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-aca21a2e-b66c-4adf-8fbb-1f34b1b260b4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079696 Jul 28 03:50:06.155039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 747/1151] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:06 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:07.084384 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-266b2fbd-1224-4c72-b24a-bf34d5d5470e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:07.085281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-266b2fbd-1224-4c72-b24a-bf34d5d5470e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:07.091411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-266b2fbd-1224-4c72-b24a-bf34d5d5470e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:07.091949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-266b2fbd-1224-4c72-b24a-bf34d5d5470e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:07.092709 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-266b2fbd-1224-4c72-b24a-bf34d5d5470e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:07.093142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-266b2fbd-1224-4c72-b24a-bf34d5d5470e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:07.200650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-266b2fbd-1224-4c72-b24a-bf34d5d5470e tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 26627 microversion: 2.20 time: 0.119829 Jul 28 03:50:07.201286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 748/1152] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:07 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 26627 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:07.206040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-89007257-8019-40f5-b26a-e9f8c4ba8396 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:07.206721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-89007257-8019-40f5-b26a-e9f8c4ba8396 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:07.213580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89007257-8019-40f5-b26a-e9f8c4ba8396 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:07.214023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89007257-8019-40f5-b26a-e9f8c4ba8396 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:07.214776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89007257-8019-40f5-b26a-e9f8c4ba8396 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:07.215198 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-89007257-8019-40f5-b26a-e9f8c4ba8396 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:07.274746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-89007257-8019-40f5-b26a-e9f8c4ba8396 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:07.281789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-89007257-8019-40f5-b26a-e9f8c4ba8396 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079335 Jul 28 03:50:07.282334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 749/1153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:07 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:08.213131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-53df6c87-2263-4fee-9eff-a0ea59ed1a90 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:08.214007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-53df6c87-2263-4fee-9eff-a0ea59ed1a90 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:08.220286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53df6c87-2263-4fee-9eff-a0ea59ed1a90 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:08.220732 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53df6c87-2263-4fee-9eff-a0ea59ed1a90 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:08.221488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53df6c87-2263-4fee-9eff-a0ea59ed1a90 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:08.221910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53df6c87-2263-4fee-9eff-a0ea59ed1a90 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:08.317804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-53df6c87-2263-4fee-9eff-a0ea59ed1a90 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 27664 microversion: 2.20 time: 0.109106 Jul 28 03:50:08.318994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 750/1154] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:08 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 27664 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:50:08.324052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2150847f-7418-4dc5-9aa0-8cef3a9c5be6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:08.324740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2150847f-7418-4dc5-9aa0-8cef3a9c5be6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:08.332163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2150847f-7418-4dc5-9aa0-8cef3a9c5be6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:08.332163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2150847f-7418-4dc5-9aa0-8cef3a9c5be6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:08.332737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2150847f-7418-4dc5-9aa0-8cef3a9c5be6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:08.333534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2150847f-7418-4dc5-9aa0-8cef3a9c5be6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:08.400483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2150847f-7418-4dc5-9aa0-8cef3a9c5be6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:08.409957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2150847f-7418-4dc5-9aa0-8cef3a9c5be6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.088740 Jul 28 03:50:08.411183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 751/1155] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:08 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:09.329914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-724ed29c-9066-41f5-b8b7-62c7c3b89e15 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:09.330830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-724ed29c-9066-41f5-b8b7-62c7c3b89e15 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:09.337682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-724ed29c-9066-41f5-b8b7-62c7c3b89e15 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:09.338129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-724ed29c-9066-41f5-b8b7-62c7c3b89e15 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:09.338886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-724ed29c-9066-41f5-b8b7-62c7c3b89e15 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:09.339320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-724ed29c-9066-41f5-b8b7-62c7c3b89e15 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:09.433153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-724ed29c-9066-41f5-b8b7-62c7c3b89e15 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 28181 microversion: 2.20 time: 0.106724 Jul 28 03:50:09.433682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 752/1156] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:09 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 28181 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:50:09.438569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-73cc1504-9429-4abf-b671-2ff1bcd9399d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:09.439260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-73cc1504-9429-4abf-b671-2ff1bcd9399d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:09.446262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73cc1504-9429-4abf-b671-2ff1bcd9399d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:09.446734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73cc1504-9429-4abf-b671-2ff1bcd9399d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:09.447489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73cc1504-9429-4abf-b671-2ff1bcd9399d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:09.447955 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73cc1504-9429-4abf-b671-2ff1bcd9399d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:09.516654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-73cc1504-9429-4abf-b671-2ff1bcd9399d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:09.525019 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-73cc1504-9429-4abf-b671-2ff1bcd9399d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.090102 Jul 28 03:50:09.525666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 753/1157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:09 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:10.443992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-350de6d2-d467-4ecd-a7c4-0f24e290eaf1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:10.444902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-350de6d2-d467-4ecd-a7c4-0f24e290eaf1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:10.451028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-350de6d2-d467-4ecd-a7c4-0f24e290eaf1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:10.451471 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-350de6d2-d467-4ecd-a7c4-0f24e290eaf1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:10.452277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-350de6d2-d467-4ecd-a7c4-0f24e290eaf1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:10.452712 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-350de6d2-d467-4ecd-a7c4-0f24e290eaf1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:10.551665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-350de6d2-d467-4ecd-a7c4-0f24e290eaf1 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 28183 microversion: 2.20 time: 0.111139 Jul 28 03:50:10.556322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 754/1158] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:10 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 28183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:10.557827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-24049deb-e9a9-47ca-a0be-578edf55edaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:10.558523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-24049deb-e9a9-47ca-a0be-578edf55edaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:10.564864 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24049deb-e9a9-47ca-a0be-578edf55edaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:10.565314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24049deb-e9a9-47ca-a0be-578edf55edaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:10.566090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24049deb-e9a9-47ca-a0be-578edf55edaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:10.566531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24049deb-e9a9-47ca-a0be-578edf55edaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:10.626314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-24049deb-e9a9-47ca-a0be-578edf55edaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:10.633626 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-24049deb-e9a9-47ca-a0be-578edf55edaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079531 Jul 28 03:50:10.634174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 755/1159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:10 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:11.564127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-97cda832-f71e-4bfb-aadf-1e3a1be91c92 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:11.564880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-97cda832-f71e-4bfb-aadf-1e3a1be91c92 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:11.574612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-97cda832-f71e-4bfb-aadf-1e3a1be91c92 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:11.575057 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-97cda832-f71e-4bfb-aadf-1e3a1be91c92 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:11.575859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-97cda832-f71e-4bfb-aadf-1e3a1be91c92 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:11.576298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-97cda832-f71e-4bfb-aadf-1e3a1be91c92 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:11.673239 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-97cda832-f71e-4bfb-aadf-1e3a1be91c92 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 28473 microversion: 2.20 time: 0.112746 Jul 28 03:50:11.673896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 756/1160] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:11 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 28473 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:11.679598 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f69880c7-c875-4baa-aa1d-a2cb7815cf00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:11.680322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f69880c7-c875-4baa-aa1d-a2cb7815cf00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:11.686969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f69880c7-c875-4baa-aa1d-a2cb7815cf00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:11.687426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f69880c7-c875-4baa-aa1d-a2cb7815cf00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:11.688234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f69880c7-c875-4baa-aa1d-a2cb7815cf00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:11.688667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f69880c7-c875-4baa-aa1d-a2cb7815cf00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:11.749716 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f69880c7-c875-4baa-aa1d-a2cb7815cf00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:11.757358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f69880c7-c875-4baa-aa1d-a2cb7815cf00 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.082353 Jul 28 03:50:11.757924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 757/1161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:11 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:12.694320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e7d947c1-0734-424f-aebd-e35c3b3c27ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:12.695233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e7d947c1-0734-424f-aebd-e35c3b3c27ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:12.701305 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7d947c1-0734-424f-aebd-e35c3b3c27ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:12.701747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7d947c1-0734-424f-aebd-e35c3b3c27ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:12.702506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7d947c1-0734-424f-aebd-e35c3b3c27ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:12.702934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7d947c1-0734-424f-aebd-e35c3b3c27ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:12.793702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e7d947c1-0734-424f-aebd-e35c3b3c27ec tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 28641 microversion: 2.20 time: 0.103713 Jul 28 03:50:12.794379 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 758/1162] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:12 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 28641 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:12.799177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-baaab060-85c2-4ea2-aab2-13198e092a53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:12.799899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-baaab060-85c2-4ea2-aab2-13198e092a53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:12.806328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-baaab060-85c2-4ea2-aab2-13198e092a53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:12.806896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-baaab060-85c2-4ea2-aab2-13198e092a53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:12.807667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-baaab060-85c2-4ea2-aab2-13198e092a53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:12.808135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-baaab060-85c2-4ea2-aab2-13198e092a53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:12.868301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-baaab060-85c2-4ea2-aab2-13198e092a53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:12.875396 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-baaab060-85c2-4ea2-aab2-13198e092a53 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079932 Jul 28 03:50:12.875975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 759/1163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:12 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:13.805614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4a8e73be-03ec-4f3c-a897-d95cefc5118a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:13.806520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4a8e73be-03ec-4f3c-a897-d95cefc5118a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:13.812687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a8e73be-03ec-4f3c-a897-d95cefc5118a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:13.813125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a8e73be-03ec-4f3c-a897-d95cefc5118a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:13.813881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a8e73be-03ec-4f3c-a897-d95cefc5118a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:13.814310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a8e73be-03ec-4f3c-a897-d95cefc5118a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:13.899514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4a8e73be-03ec-4f3c-a897-d95cefc5118a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 28641 microversion: 2.20 time: 0.098093 Jul 28 03:50:13.901096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 760/1164] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:13 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 28641 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:13.905058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-021c06b0-0f7e-4a13-bab0-a088fa57b291 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:13.905742 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-021c06b0-0f7e-4a13-bab0-a088fa57b291 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:13.912362 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-021c06b0-0f7e-4a13-bab0-a088fa57b291 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:13.912846 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-021c06b0-0f7e-4a13-bab0-a088fa57b291 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:13.913669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-021c06b0-0f7e-4a13-bab0-a088fa57b291 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:13.914096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-021c06b0-0f7e-4a13-bab0-a088fa57b291 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:13.978551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-021c06b0-0f7e-4a13-bab0-a088fa57b291 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:13.989360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-021c06b0-0f7e-4a13-bab0-a088fa57b291 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.087544 Jul 28 03:50:13.990833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 761/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:13 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:14.910777 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a292c8f6-0dea-4016-acfe-0bd9f2544c46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:14.911690 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a292c8f6-0dea-4016-acfe-0bd9f2544c46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:14.917787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a292c8f6-0dea-4016-acfe-0bd9f2544c46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:14.918233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a292c8f6-0dea-4016-acfe-0bd9f2544c46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:14.918997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a292c8f6-0dea-4016-acfe-0bd9f2544c46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:14.919429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a292c8f6-0dea-4016-acfe-0bd9f2544c46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:15.009521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a292c8f6-0dea-4016-acfe-0bd9f2544c46 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 28641 microversion: 2.20 time: 0.102259 Jul 28 03:50:15.012810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 762/1166] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:14 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 28641 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:15.016118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f7917d2d-d4be-4091-a05b-582d2f0873bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:15.016808 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f7917d2d-d4be-4091-a05b-582d2f0873bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:15.023490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7917d2d-d4be-4091-a05b-582d2f0873bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:15.023979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7917d2d-d4be-4091-a05b-582d2f0873bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:15.024743 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7917d2d-d4be-4091-a05b-582d2f0873bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:15.025174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7917d2d-d4be-4091-a05b-582d2f0873bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:15.084704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f7917d2d-d4be-4091-a05b-582d2f0873bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:15.091809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f7917d2d-d4be-4091-a05b-582d2f0873bb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080538 Jul 28 03:50:15.092357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 763/1167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:15 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:16.020816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-54852dd5-5761-4419-a376-124ce8a5f28c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:16.022162 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-54852dd5-5761-4419-a376-124ce8a5f28c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:16.028818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54852dd5-5761-4419-a376-124ce8a5f28c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:16.029094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54852dd5-5761-4419-a376-124ce8a5f28c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:16.029871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54852dd5-5761-4419-a376-124ce8a5f28c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:16.030308 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54852dd5-5761-4419-a376-124ce8a5f28c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:16.133313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-54852dd5-5761-4419-a376-124ce8a5f28c tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 29402 microversion: 2.20 time: 0.116079 Jul 28 03:50:16.133949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 764/1168] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:16 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 29402 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:16.138953 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f793b627-9f66-4c52-9eaa-7525f3d90aa2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:16.139652 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f793b627-9f66-4c52-9eaa-7525f3d90aa2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:16.146105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f793b627-9f66-4c52-9eaa-7525f3d90aa2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:16.146566 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f793b627-9f66-4c52-9eaa-7525f3d90aa2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:16.147333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f793b627-9f66-4c52-9eaa-7525f3d90aa2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:16.147793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f793b627-9f66-4c52-9eaa-7525f3d90aa2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:16.212223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f793b627-9f66-4c52-9eaa-7525f3d90aa2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:16.219442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f793b627-9f66-4c52-9eaa-7525f3d90aa2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.084262 Jul 28 03:50:16.220035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 765/1169] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:16 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:17.144633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-611da91e-7543-44c5-8fcf-995226b4154b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:17.145542 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-611da91e-7543-44c5-8fcf-995226b4154b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:17.151916 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-611da91e-7543-44c5-8fcf-995226b4154b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:17.152367 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-611da91e-7543-44c5-8fcf-995226b4154b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:17.153126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-611da91e-7543-44c5-8fcf-995226b4154b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:17.153564 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-611da91e-7543-44c5-8fcf-995226b4154b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:17.245564 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-611da91e-7543-44c5-8fcf-995226b4154b tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 31546 microversion: 2.20 time: 0.104447 Jul 28 03:50:17.249839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 766/1170] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:17 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 31546 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:17.250889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d5e3e6b4-f35b-4b65-9c65-54c2f60dcb5d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:17.251585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d5e3e6b4-f35b-4b65-9c65-54c2f60dcb5d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:17.258042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5e3e6b4-f35b-4b65-9c65-54c2f60dcb5d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:17.258495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5e3e6b4-f35b-4b65-9c65-54c2f60dcb5d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:17.259263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5e3e6b4-f35b-4b65-9c65-54c2f60dcb5d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:17.259700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5e3e6b4-f35b-4b65-9c65-54c2f60dcb5d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:17.318770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d5e3e6b4-f35b-4b65-9c65-54c2f60dcb5d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:17.326024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d5e3e6b4-f35b-4b65-9c65-54c2f60dcb5d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078737 Jul 28 03:50:17.326581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 767/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:17 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:18.257673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4e95b142-d9c5-4082-a9a6-75e91755bc6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:18.258580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4e95b142-d9c5-4082-a9a6-75e91755bc6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:18.264810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4e95b142-d9c5-4082-a9a6-75e91755bc6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:18.265260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4e95b142-d9c5-4082-a9a6-75e91755bc6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:18.266024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4e95b142-d9c5-4082-a9a6-75e91755bc6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:18.266459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4e95b142-d9c5-4082-a9a6-75e91755bc6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:18.360074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4e95b142-d9c5-4082-a9a6-75e91755bc6f tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 33167 microversion: 2.20 time: 0.106628 Jul 28 03:50:18.360680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 768/1172] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:18 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 33167 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:18.365800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a5db857b-be99-46a1-9b0d-b5bd55ee4f92 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:18.366479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a5db857b-be99-46a1-9b0d-b5bd55ee4f92 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:18.372660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a5db857b-be99-46a1-9b0d-b5bd55ee4f92 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:18.373104 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a5db857b-be99-46a1-9b0d-b5bd55ee4f92 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:18.373892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a5db857b-be99-46a1-9b0d-b5bd55ee4f92 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:18.374322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a5db857b-be99-46a1-9b0d-b5bd55ee4f92 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:18.433540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a5db857b-be99-46a1-9b0d-b5bd55ee4f92 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:18.440666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a5db857b-be99-46a1-9b0d-b5bd55ee4f92 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078911 Jul 28 03:50:18.441213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 769/1173] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:18 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:19.371560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-336f0042-bbb2-484b-aa41-0073b2d6d478 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:19.372519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-336f0042-bbb2-484b-aa41-0073b2d6d478 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:19.378665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-336f0042-bbb2-484b-aa41-0073b2d6d478 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:19.379112 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-336f0042-bbb2-484b-aa41-0073b2d6d478 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:19.379941 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-336f0042-bbb2-484b-aa41-0073b2d6d478 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:19.380908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-336f0042-bbb2-484b-aa41-0073b2d6d478 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:19.467948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-336f0042-bbb2-484b-aa41-0073b2d6d478 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 34120 microversion: 2.20 time: 0.099863 Jul 28 03:50:19.468541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 770/1174] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:19 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 34120 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:19.473197 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d4922cca-b445-4223-8db6-494e4936c936 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:19.473883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d4922cca-b445-4223-8db6-494e4936c936 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:19.480980 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d4922cca-b445-4223-8db6-494e4936c936 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:19.481427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d4922cca-b445-4223-8db6-494e4936c936 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:19.482197 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d4922cca-b445-4223-8db6-494e4936c936 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:19.482630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d4922cca-b445-4223-8db6-494e4936c936 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:19.541765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d4922cca-b445-4223-8db6-494e4936c936 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:19.549001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d4922cca-b445-4223-8db6-494e4936c936 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079433 Jul 28 03:50:19.549545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 771/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:19 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:20.480270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-46a7b8d3-6a2e-4be0-aece-98d09fa83bf0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:20.481183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-46a7b8d3-6a2e-4be0-aece-98d09fa83bf0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:20.487362 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46a7b8d3-6a2e-4be0-aece-98d09fa83bf0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:20.487840 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46a7b8d3-6a2e-4be0-aece-98d09fa83bf0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:20.488604 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46a7b8d3-6a2e-4be0-aece-98d09fa83bf0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:20.489037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46a7b8d3-6a2e-4be0-aece-98d09fa83bf0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:20.578000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-46a7b8d3-6a2e-4be0-aece-98d09fa83bf0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 35378 microversion: 2.20 time: 0.101269 Jul 28 03:50:20.578538 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 772/1176] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:20 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 35378 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:20.583961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-58b9def2-27bf-4cc6-8c9a-4dd6ef553a20 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:20.584670 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-58b9def2-27bf-4cc6-8c9a-4dd6ef553a20 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:20.590961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-58b9def2-27bf-4cc6-8c9a-4dd6ef553a20 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:20.591415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-58b9def2-27bf-4cc6-8c9a-4dd6ef553a20 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:20.592215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-58b9def2-27bf-4cc6-8c9a-4dd6ef553a20 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:20.592654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-58b9def2-27bf-4cc6-8c9a-4dd6ef553a20 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:20.651639 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-58b9def2-27bf-4cc6-8c9a-4dd6ef553a20 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:20.658808 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-58b9def2-27bf-4cc6-8c9a-4dd6ef553a20 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079014 Jul 28 03:50:20.659371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 773/1177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:20 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:21.590454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-76317467-3121-4e28-9efa-24453f9e2660 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:21.591377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-76317467-3121-4e28-9efa-24453f9e2660 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:21.597521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76317467-3121-4e28-9efa-24453f9e2660 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:21.597966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76317467-3121-4e28-9efa-24453f9e2660 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:21.598728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76317467-3121-4e28-9efa-24453f9e2660 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:21.599161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76317467-3121-4e28-9efa-24453f9e2660 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:21.687386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-76317467-3121-4e28-9efa-24453f9e2660 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 36965 microversion: 2.20 time: 0.100497 Jul 28 03:50:21.688100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 774/1178] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:21 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 36965 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:21.692901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-19428a03-245a-47d5-b2bc-388366f8dbc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:21.693588 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-19428a03-245a-47d5-b2bc-388366f8dbc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:21.700461 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19428a03-245a-47d5-b2bc-388366f8dbc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:21.700908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19428a03-245a-47d5-b2bc-388366f8dbc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:21.701669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19428a03-245a-47d5-b2bc-388366f8dbc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:21.702102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-19428a03-245a-47d5-b2bc-388366f8dbc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:21.761307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-19428a03-245a-47d5-b2bc-388366f8dbc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:21.768429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-19428a03-245a-47d5-b2bc-388366f8dbc0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079071 Jul 28 03:50:21.768984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 775/1179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:21 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:22.699035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-828555e4-e827-4c48-8c3b-9bc85268e499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:22.699977 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-828555e4-e827-4c48-8c3b-9bc85268e499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:22.706113 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-828555e4-e827-4c48-8c3b-9bc85268e499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:22.706562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-828555e4-e827-4c48-8c3b-9bc85268e499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:22.707323 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-828555e4-e827-4c48-8c3b-9bc85268e499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:22.707785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-828555e4-e827-4c48-8c3b-9bc85268e499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:22.802556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-828555e4-e827-4c48-8c3b-9bc85268e499 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 38199 microversion: 2.20 time: 0.107104 Jul 28 03:50:22.803170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 776/1180] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:22 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 38199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:22.808243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-368600ac-cc6b-42e4-b5a8-323660744d73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:22.808928 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-368600ac-cc6b-42e4-b5a8-323660744d73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:22.815053 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-368600ac-cc6b-42e4-b5a8-323660744d73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:22.815497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-368600ac-cc6b-42e4-b5a8-323660744d73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:22.816284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-368600ac-cc6b-42e4-b5a8-323660744d73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:22.816717 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-368600ac-cc6b-42e4-b5a8-323660744d73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:22.885244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-368600ac-cc6b-42e4-b5a8-323660744d73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:22.892740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-368600ac-cc6b-42e4-b5a8-323660744d73 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.088177 Jul 28 03:50:22.893298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 777/1181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:22 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:23.814370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2772adf4-166e-4396-bf59-2abc9feb73e0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:23.815203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2772adf4-166e-4396-bf59-2abc9feb73e0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:23.821675 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2772adf4-166e-4396-bf59-2abc9feb73e0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:23.822115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2772adf4-166e-4396-bf59-2abc9feb73e0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:23.822868 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2772adf4-166e-4396-bf59-2abc9feb73e0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:23.823297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2772adf4-166e-4396-bf59-2abc9feb73e0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:23.902740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2772adf4-166e-4396-bf59-2abc9feb73e0 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 38199 microversion: 2.20 time: 0.091974 Jul 28 03:50:23.903388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 778/1182] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:23 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 38199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:23.910011 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5c147fe6-4a5a-4c26-bb14-a95f552b409e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:23.910714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5c147fe6-4a5a-4c26-bb14-a95f552b409e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:23.917673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c147fe6-4a5a-4c26-bb14-a95f552b409e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:23.918116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c147fe6-4a5a-4c26-bb14-a95f552b409e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:23.918870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c147fe6-4a5a-4c26-bb14-a95f552b409e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:23.919294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c147fe6-4a5a-4c26-bb14-a95f552b409e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:23.980066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5c147fe6-4a5a-4c26-bb14-a95f552b409e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:23.987388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5c147fe6-4a5a-4c26-bb14-a95f552b409e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.081014 Jul 28 03:50:23.988026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 779/1183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:23 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:24.914705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b98c5e62-dd7c-4ffe-be92-60611adc63ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:24.915607 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b98c5e62-dd7c-4ffe-be92-60611adc63ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:24.921714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b98c5e62-dd7c-4ffe-be92-60611adc63ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:24.922155 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b98c5e62-dd7c-4ffe-be92-60611adc63ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:24.922907 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b98c5e62-dd7c-4ffe-be92-60611adc63ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:24.923339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b98c5e62-dd7c-4ffe-be92-60611adc63ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:25.005436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b98c5e62-dd7c-4ffe-be92-60611adc63ac tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 38199 microversion: 2.20 time: 0.094648 Jul 28 03:50:25.006042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 780/1184] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:24 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 38199 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:25.011761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f2f8eed8-ac68-4197-9f34-fb6b1d9d73ee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:25.012449 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f2f8eed8-ac68-4197-9f34-fb6b1d9d73ee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:25.018642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f2f8eed8-ac68-4197-9f34-fb6b1d9d73ee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:25.019085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f2f8eed8-ac68-4197-9f34-fb6b1d9d73ee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:25.019869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f2f8eed8-ac68-4197-9f34-fb6b1d9d73ee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:25.020301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f2f8eed8-ac68-4197-9f34-fb6b1d9d73ee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:25.081895 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f2f8eed8-ac68-4197-9f34-fb6b1d9d73ee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:25.089520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f2f8eed8-ac68-4197-9f34-fb6b1d9d73ee tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.082411 Jul 28 03:50:25.090073 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 781/1185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:25 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:26.018637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2f518195-33b8-44c3-b18d-38f8f9679448 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:26.019545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2f518195-33b8-44c3-b18d-38f8f9679448 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:26.029820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f518195-33b8-44c3-b18d-38f8f9679448 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:26.030270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f518195-33b8-44c3-b18d-38f8f9679448 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:26.032545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f518195-33b8-44c3-b18d-38f8f9679448 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:26.032545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f518195-33b8-44c3-b18d-38f8f9679448 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:26.113460 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2f518195-33b8-44c3-b18d-38f8f9679448 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 38199 microversion: 2.20 time: 0.098855 Jul 28 03:50:26.114081 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 782/1186] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:26 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 38199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:50:26.118888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5a333161-e52b-4561-a3d1-5875daa32c18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:26.119578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5a333161-e52b-4561-a3d1-5875daa32c18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:26.125992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a333161-e52b-4561-a3d1-5875daa32c18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:26.126434 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a333161-e52b-4561-a3d1-5875daa32c18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:26.127186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a333161-e52b-4561-a3d1-5875daa32c18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:26.127613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a333161-e52b-4561-a3d1-5875daa32c18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:26.189476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5a333161-e52b-4561-a3d1-5875daa32c18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:26.197371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5a333161-e52b-4561-a3d1-5875daa32c18 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.082183 Jul 28 03:50:26.197925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 783/1187] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:26 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:27.125225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-92e24005-7a3a-4565-af08-acd8b4c61cfc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:27.126027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-92e24005-7a3a-4565-af08-acd8b4c61cfc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:27.132346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92e24005-7a3a-4565-af08-acd8b4c61cfc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:27.132947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92e24005-7a3a-4565-af08-acd8b4c61cfc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:27.133713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92e24005-7a3a-4565-af08-acd8b4c61cfc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:27.134149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92e24005-7a3a-4565-af08-acd8b4c61cfc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:27.220244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-92e24005-7a3a-4565-af08-acd8b4c61cfc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action" status: 200 len: 38342 microversion: 2.20 time: 0.098655 Jul 28 03:50:27.220874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 784/1188] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Jul 28 03:50:27 2021] POST /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/action => generated 38342 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:27.226757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ab4c6c53-1861-4b21-9443-dd205f3b1ca5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:27.227539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ab4c6c53-1861-4b21-9443-dd205f3b1ca5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:27.233879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab4c6c53-1861-4b21-9443-dd205f3b1ca5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:27.234321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab4c6c53-1861-4b21-9443-dd205f3b1ca5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:27.235075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab4c6c53-1861-4b21-9443-dd205f3b1ca5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:27.235505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab4c6c53-1861-4b21-9443-dd205f3b1ca5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:27.295139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ab4c6c53-1861-4b21-9443-dd205f3b1ca5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:27.302405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ab4c6c53-1861-4b21-9443-dd205f3b1ca5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080450 Jul 28 03:50:27.302956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 785/1189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:27 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:27.307184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bbb23c11-7087-4773-adc7-e8eaec6e0d64 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:27.307677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bbb23c11-7087-4773-adc7-e8eaec6e0d64 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:27.313049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbb23c11-7087-4773-adc7-e8eaec6e0d64 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:27.313504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbb23c11-7087-4773-adc7-e8eaec6e0d64 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:27.314268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbb23c11-7087-4773-adc7-e8eaec6e0d64 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:27.314704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbb23c11-7087-4773-adc7-e8eaec6e0d64 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:27.338069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bbb23c11-7087-4773-adc7-e8eaec6e0d64 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/ips" status: 200 len: 151 microversion: 2.20 time: 0.034059 Jul 28 03:50:27.338634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 786/1190] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Jul 28 03:50:27 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df/ips => generated 151 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:50:28.319133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-65b2a10d-4af2-458a-926a-a42e789d57a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:28.320296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-65b2a10d-4af2-458a-926a-a42e789d57a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:28.326559 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65b2a10d-4af2-458a-926a-a42e789d57a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:28.327002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65b2a10d-4af2-458a-926a-a42e789d57a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:28.327776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65b2a10d-4af2-458a-926a-a42e789d57a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:28.328205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65b2a10d-4af2-458a-926a-a42e789d57a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:28.389044 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-65b2a10d-4af2-458a-926a-a42e789d57a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:28.396454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-65b2a10d-4af2-458a-926a-a42e789d57a1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.081058 Jul 28 03:50:28.397007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 787/1191] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:28 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:29.414827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-770b5d68-7ed8-4384-b7c2-e23e74197b23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:29.415417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-770b5d68-7ed8-4384-b7c2-e23e74197b23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:29.421209 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-770b5d68-7ed8-4384-b7c2-e23e74197b23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:29.421660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-770b5d68-7ed8-4384-b7c2-e23e74197b23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:29.422431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-770b5d68-7ed8-4384-b7c2-e23e74197b23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:29.422865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-770b5d68-7ed8-4384-b7c2-e23e74197b23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:29.486987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-770b5d68-7ed8-4384-b7c2-e23e74197b23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:29.494910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-770b5d68-7ed8-4384-b7c2-e23e74197b23 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.084410 Jul 28 03:50:29.495483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 788/1192] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:29 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:30.513007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-50770772-87af-4d2b-9104-c088981db4ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:30.520519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-50770772-87af-4d2b-9104-c088981db4ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:30.527209 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50770772-87af-4d2b-9104-c088981db4ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:30.527660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50770772-87af-4d2b-9104-c088981db4ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:30.528459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50770772-87af-4d2b-9104-c088981db4ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:30.528896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50770772-87af-4d2b-9104-c088981db4ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:30.587374 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-50770772-87af-4d2b-9104-c088981db4ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:30.594531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-50770772-87af-4d2b-9104-c088981db4ad tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.085584 Jul 28 03:50:30.595079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 789/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:30 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:31.611807 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d32bdefd-2115-4be3-990e-6b5fcdcab3b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:31.612425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d32bdefd-2115-4be3-990e-6b5fcdcab3b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:31.618621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d32bdefd-2115-4be3-990e-6b5fcdcab3b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:31.619064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d32bdefd-2115-4be3-990e-6b5fcdcab3b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:31.619856 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d32bdefd-2115-4be3-990e-6b5fcdcab3b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:31.620289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d32bdefd-2115-4be3-990e-6b5fcdcab3b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:31.678492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d32bdefd-2115-4be3-990e-6b5fcdcab3b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:31.686079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d32bdefd-2115-4be3-990e-6b5fcdcab3b2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077871 Jul 28 03:50:31.686641 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 790/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:31 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:32.703249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2e8040fc-51f9-47d9-9d8d-e42cb297e2a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:32.703893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2e8040fc-51f9-47d9-9d8d-e42cb297e2a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:32.709586 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e8040fc-51f9-47d9-9d8d-e42cb297e2a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:32.710712 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e8040fc-51f9-47d9-9d8d-e42cb297e2a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:32.711497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e8040fc-51f9-47d9-9d8d-e42cb297e2a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:32.711955 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e8040fc-51f9-47d9-9d8d-e42cb297e2a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:32.769830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2e8040fc-51f9-47d9-9d8d-e42cb297e2a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:32.777713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2e8040fc-51f9-47d9-9d8d-e42cb297e2a7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078092 Jul 28 03:50:32.778269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 791/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:32 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:33.794810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a540dae3-584e-4e8c-912f-85779a73cb09 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:33.795516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a540dae3-584e-4e8c-912f-85779a73cb09 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:33.801241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a540dae3-584e-4e8c-912f-85779a73cb09 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:33.801692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a540dae3-584e-4e8c-912f-85779a73cb09 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:33.802458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a540dae3-584e-4e8c-912f-85779a73cb09 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:33.802890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a540dae3-584e-4e8c-912f-85779a73cb09 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:33.862138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a540dae3-584e-4e8c-912f-85779a73cb09 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:33.869595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a540dae3-584e-4e8c-912f-85779a73cb09 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078583 Jul 28 03:50:33.870167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 792/1196] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:33 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:34.886761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7a0c39b0-1a01-4b9c-86bf-cce28e742035 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:34.887400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7a0c39b0-1a01-4b9c-86bf-cce28e742035 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:34.893596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a0c39b0-1a01-4b9c-86bf-cce28e742035 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:34.894053 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a0c39b0-1a01-4b9c-86bf-cce28e742035 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:34.894820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a0c39b0-1a01-4b9c-86bf-cce28e742035 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:34.895256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a0c39b0-1a01-4b9c-86bf-cce28e742035 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:34.954436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7a0c39b0-1a01-4b9c-86bf-cce28e742035 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:34.961880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7a0c39b0-1a01-4b9c-86bf-cce28e742035 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078763 Jul 28 03:50:34.962442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 793/1197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:34 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:35.978634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ab7dd984-9f44-4bcd-a680-029aac07feb6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:35.979245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ab7dd984-9f44-4bcd-a680-029aac07feb6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:35.985022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab7dd984-9f44-4bcd-a680-029aac07feb6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:35.985463 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab7dd984-9f44-4bcd-a680-029aac07feb6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:35.986261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab7dd984-9f44-4bcd-a680-029aac07feb6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:35.986642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab7dd984-9f44-4bcd-a680-029aac07feb6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:36.050578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ab7dd984-9f44-4bcd-a680-029aac07feb6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:36.058990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ab7dd984-9f44-4bcd-a680-029aac07feb6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.084592 Jul 28 03:50:36.059560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 794/1198] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:35 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:37.076172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e4dfb205-b2ee-416c-8548-8c4588199101 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:37.076792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e4dfb205-b2ee-416c-8548-8c4588199101 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:37.082517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4dfb205-b2ee-416c-8548-8c4588199101 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:37.082972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4dfb205-b2ee-416c-8548-8c4588199101 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:37.083766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4dfb205-b2ee-416c-8548-8c4588199101 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:37.084209 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4dfb205-b2ee-416c-8548-8c4588199101 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:37.146363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e4dfb205-b2ee-416c-8548-8c4588199101 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:37.154152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e4dfb205-b2ee-416c-8548-8c4588199101 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.081474 Jul 28 03:50:37.154727 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 795/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:37 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:38.173658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b47cfdf1-464b-40cf-8ccb-6250c38c00ce tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:38.174367 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b47cfdf1-464b-40cf-8ccb-6250c38c00ce tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:38.181052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b47cfdf1-464b-40cf-8ccb-6250c38c00ce tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:38.181507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b47cfdf1-464b-40cf-8ccb-6250c38c00ce tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:38.182283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b47cfdf1-464b-40cf-8ccb-6250c38c00ce tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:38.182722 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b47cfdf1-464b-40cf-8ccb-6250c38c00ce tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:38.243560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b47cfdf1-464b-40cf-8ccb-6250c38c00ce tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:38.250744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b47cfdf1-464b-40cf-8ccb-6250c38c00ce tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080916 Jul 28 03:50:38.251306 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 796/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:38 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:39.268167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ea354ea2-d2da-439c-b9d6-dd7ff572f1e7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:39.268774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ea354ea2-d2da-439c-b9d6-dd7ff572f1e7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:39.275426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea354ea2-d2da-439c-b9d6-dd7ff572f1e7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:39.275920 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea354ea2-d2da-439c-b9d6-dd7ff572f1e7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:39.276697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea354ea2-d2da-439c-b9d6-dd7ff572f1e7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:39.277135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea354ea2-d2da-439c-b9d6-dd7ff572f1e7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:39.336623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ea354ea2-d2da-439c-b9d6-dd7ff572f1e7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:39.343964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ea354ea2-d2da-439c-b9d6-dd7ff572f1e7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079559 Jul 28 03:50:39.344516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 797/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:39 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:40.361540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-05b34442-17cf-4e6f-8248-71aa93351157 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:40.362184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-05b34442-17cf-4e6f-8248-71aa93351157 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:40.368830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-05b34442-17cf-4e6f-8248-71aa93351157 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:40.369283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-05b34442-17cf-4e6f-8248-71aa93351157 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:40.370060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-05b34442-17cf-4e6f-8248-71aa93351157 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:40.370496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-05b34442-17cf-4e6f-8248-71aa93351157 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:40.430474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-05b34442-17cf-4e6f-8248-71aa93351157 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:40.437948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-05b34442-17cf-4e6f-8248-71aa93351157 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079983 Jul 28 03:50:40.438514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 798/1202] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:40 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:41.454406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-56eda1c0-4062-41fa-9637-fca62f1858ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:41.454999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-56eda1c0-4062-41fa-9637-fca62f1858ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:41.461023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-56eda1c0-4062-41fa-9637-fca62f1858ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:41.461465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-56eda1c0-4062-41fa-9637-fca62f1858ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:41.462219 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-56eda1c0-4062-41fa-9637-fca62f1858ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:41.462651 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-56eda1c0-4062-41fa-9637-fca62f1858ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:41.521423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-56eda1c0-4062-41fa-9637-fca62f1858ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:41.528847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-56eda1c0-4062-41fa-9637-fca62f1858ea tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078037 Jul 28 03:50:41.529404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 799/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:41 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:42.545328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4bd636d4-2277-482f-a3c6-9a2e09f93505 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:42.545971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4bd636d4-2277-482f-a3c6-9a2e09f93505 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:42.551656 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4bd636d4-2277-482f-a3c6-9a2e09f93505 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:42.552126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4bd636d4-2277-482f-a3c6-9a2e09f93505 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:42.552875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4bd636d4-2277-482f-a3c6-9a2e09f93505 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:42.553298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4bd636d4-2277-482f-a3c6-9a2e09f93505 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:42.615108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4bd636d4-2277-482f-a3c6-9a2e09f93505 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:42.623072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4bd636d4-2277-482f-a3c6-9a2e09f93505 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.081393 Jul 28 03:50:42.623627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 800/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:42 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:43.639534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-82f2190b-c192-47d6-a8c3-98fbbfd21080 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:43.640264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-82f2190b-c192-47d6-a8c3-98fbbfd21080 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:43.646328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82f2190b-c192-47d6-a8c3-98fbbfd21080 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:43.646718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82f2190b-c192-47d6-a8c3-98fbbfd21080 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:43.647518 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82f2190b-c192-47d6-a8c3-98fbbfd21080 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:43.648059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82f2190b-c192-47d6-a8c3-98fbbfd21080 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:43.706290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-82f2190b-c192-47d6-a8c3-98fbbfd21080 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:43.716015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-82f2190b-c192-47d6-a8c3-98fbbfd21080 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079797 Jul 28 03:50:43.716959 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 801/1205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:43 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:44.733704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-96f73874-f590-4ee1-9995-211fbf33d1ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:44.734296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-96f73874-f590-4ee1-9995-211fbf33d1ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:44.739992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96f73874-f590-4ee1-9995-211fbf33d1ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:44.740440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96f73874-f590-4ee1-9995-211fbf33d1ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:44.741255 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96f73874-f590-4ee1-9995-211fbf33d1ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:44.741685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96f73874-f590-4ee1-9995-211fbf33d1ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:44.800704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-96f73874-f590-4ee1-9995-211fbf33d1ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:44.808004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-96f73874-f590-4ee1-9995-211fbf33d1ef tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077972 Jul 28 03:50:44.808554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 802/1206] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:44 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:45.824416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a3976bdd-ce74-42ea-bef2-7c1c1c36580c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:45.825031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a3976bdd-ce74-42ea-bef2-7c1c1c36580c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:45.830801 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a3976bdd-ce74-42ea-bef2-7c1c1c36580c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:45.831257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a3976bdd-ce74-42ea-bef2-7c1c1c36580c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:45.832047 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a3976bdd-ce74-42ea-bef2-7c1c1c36580c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:45.832482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a3976bdd-ce74-42ea-bef2-7c1c1c36580c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:45.890825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a3976bdd-ce74-42ea-bef2-7c1c1c36580c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:45.898465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a3976bdd-ce74-42ea-bef2-7c1c1c36580c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077654 Jul 28 03:50:45.899018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 803/1207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:45 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:46.915654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b66b1e47-ae4c-4c4b-927f-14a14ca16e2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:46.916317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b66b1e47-ae4c-4c4b-927f-14a14ca16e2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:46.922004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b66b1e47-ae4c-4c4b-927f-14a14ca16e2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:46.922474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b66b1e47-ae4c-4c4b-927f-14a14ca16e2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:46.923224 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b66b1e47-ae4c-4c4b-927f-14a14ca16e2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:46.923654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b66b1e47-ae4c-4c4b-927f-14a14ca16e2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:46.982067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b66b1e47-ae4c-4c4b-927f-14a14ca16e2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:46.989203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b66b1e47-ae4c-4c4b-927f-14a14ca16e2c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077964 Jul 28 03:50:46.989753 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 804/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:46 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:48.006097 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5c7ab385-26c1-4b08-a5a5-4193ce2adcda tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:48.007322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5c7ab385-26c1-4b08-a5a5-4193ce2adcda tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:48.013124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c7ab385-26c1-4b08-a5a5-4193ce2adcda tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:48.013571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c7ab385-26c1-4b08-a5a5-4193ce2adcda tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:48.014330 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c7ab385-26c1-4b08-a5a5-4193ce2adcda tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:48.014763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5c7ab385-26c1-4b08-a5a5-4193ce2adcda tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:48.073508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5c7ab385-26c1-4b08-a5a5-4193ce2adcda tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:48.080713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5c7ab385-26c1-4b08-a5a5-4193ce2adcda tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078314 Jul 28 03:50:48.081268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 805/1209] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:48 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:49.097900 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-51a60f57-7247-4975-a759-2265ced6524e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:49.098546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-51a60f57-7247-4975-a759-2265ced6524e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:49.105178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-51a60f57-7247-4975-a759-2265ced6524e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:49.105622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-51a60f57-7247-4975-a759-2265ced6524e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:49.106387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-51a60f57-7247-4975-a759-2265ced6524e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:49.106816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-51a60f57-7247-4975-a759-2265ced6524e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:49.168805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-51a60f57-7247-4975-a759-2265ced6524e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:49.176716 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-51a60f57-7247-4975-a759-2265ced6524e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.082351 Jul 28 03:50:49.177271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 806/1210] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:49 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:50.192427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4ae2ca55-ee9b-42c7-836b-ada8ca202ae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:50.193090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4ae2ca55-ee9b-42c7-836b-ada8ca202ae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:50.198792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ae2ca55-ee9b-42c7-836b-ada8ca202ae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:50.199226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ae2ca55-ee9b-42c7-836b-ada8ca202ae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:50.200026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ae2ca55-ee9b-42c7-836b-ada8ca202ae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:50.200450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ae2ca55-ee9b-42c7-836b-ada8ca202ae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:50.258758 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4ae2ca55-ee9b-42c7-836b-ada8ca202ae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:50.265859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4ae2ca55-ee9b-42c7-836b-ada8ca202ae7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077083 Jul 28 03:50:50.266410 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 807/1211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:50 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:51.283292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1b364243-ec73-4f05-ac73-a98688e3cd0a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:51.283988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1b364243-ec73-4f05-ac73-a98688e3cd0a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:51.290341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b364243-ec73-4f05-ac73-a98688e3cd0a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:51.290789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b364243-ec73-4f05-ac73-a98688e3cd0a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:51.291557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b364243-ec73-4f05-ac73-a98688e3cd0a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:51.292016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b364243-ec73-4f05-ac73-a98688e3cd0a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:51.350737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1b364243-ec73-4f05-ac73-a98688e3cd0a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:51.358115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1b364243-ec73-4f05-ac73-a98688e3cd0a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078660 Jul 28 03:50:51.358675 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 808/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:51 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:52.375744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-18b2bc01-72b4-4211-a114-c30fd976489c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:52.376399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-18b2bc01-72b4-4211-a114-c30fd976489c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:52.382678 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18b2bc01-72b4-4211-a114-c30fd976489c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:52.383293 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18b2bc01-72b4-4211-a114-c30fd976489c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:52.384088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18b2bc01-72b4-4211-a114-c30fd976489c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:52.384522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-18b2bc01-72b4-4211-a114-c30fd976489c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:52.444981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-18b2bc01-72b4-4211-a114-c30fd976489c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:52.452421 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-18b2bc01-72b4-4211-a114-c30fd976489c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080456 Jul 28 03:50:52.452965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 809/1213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:52 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:53.469204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-81bc925e-cdae-45dc-a7d7-ee1336f6e789 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:53.469901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-81bc925e-cdae-45dc-a7d7-ee1336f6e789 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:53.476441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81bc925e-cdae-45dc-a7d7-ee1336f6e789 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:53.476893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81bc925e-cdae-45dc-a7d7-ee1336f6e789 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:53.477667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81bc925e-cdae-45dc-a7d7-ee1336f6e789 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:53.478104 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81bc925e-cdae-45dc-a7d7-ee1336f6e789 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:53.536696 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-81bc925e-cdae-45dc-a7d7-ee1336f6e789 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:53.544955 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-81bc925e-cdae-45dc-a7d7-ee1336f6e789 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079406 Jul 28 03:50:53.545512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 810/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:53 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:54.561795 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0c6dab98-05a0-4206-9ed7-d8cc559ab873 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:54.562412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0c6dab98-05a0-4206-9ed7-d8cc559ab873 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:54.568014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c6dab98-05a0-4206-9ed7-d8cc559ab873 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:54.568464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c6dab98-05a0-4206-9ed7-d8cc559ab873 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:54.569223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c6dab98-05a0-4206-9ed7-d8cc559ab873 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:54.569677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c6dab98-05a0-4206-9ed7-d8cc559ab873 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:54.628058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0c6dab98-05a0-4206-9ed7-d8cc559ab873 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:54.635433 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0c6dab98-05a0-4206-9ed7-d8cc559ab873 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077458 Jul 28 03:50:54.636071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 811/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:54 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:55.652233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bb077eed-48bd-417e-97e4-d573235a1bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:55.652900 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bb077eed-48bd-417e-97e4-d573235a1bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:55.658653 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bb077eed-48bd-417e-97e4-d573235a1bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:55.659102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bb077eed-48bd-417e-97e4-d573235a1bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:55.659905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bb077eed-48bd-417e-97e4-d573235a1bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:55.660342 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bb077eed-48bd-417e-97e4-d573235a1bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:55.722608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bb077eed-48bd-417e-97e4-d573235a1bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:55.730516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bb077eed-48bd-417e-97e4-d573235a1bbc tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.081957 Jul 28 03:50:55.731065 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 812/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:55 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:56.746534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d547f770-64b2-4890-85ec-18cdd2caae2d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:56.747258 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d547f770-64b2-4890-85ec-18cdd2caae2d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:56.752873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d547f770-64b2-4890-85ec-18cdd2caae2d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:56.753297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d547f770-64b2-4890-85ec-18cdd2caae2d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:56.754054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d547f770-64b2-4890-85ec-18cdd2caae2d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:56.754480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d547f770-64b2-4890-85ec-18cdd2caae2d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:56.812822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d547f770-64b2-4890-85ec-18cdd2caae2d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:56.819999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d547f770-64b2-4890-85ec-18cdd2caae2d tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077012 Jul 28 03:50:56.820546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 813/1217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:56 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:57.837532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d381cd6b-ff67-41f6-b33d-dad96e25ec98 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:57.838154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d381cd6b-ff67-41f6-b33d-dad96e25ec98 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:57.843792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d381cd6b-ff67-41f6-b33d-dad96e25ec98 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:57.844243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d381cd6b-ff67-41f6-b33d-dad96e25ec98 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:57.844994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d381cd6b-ff67-41f6-b33d-dad96e25ec98 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:57.845424 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d381cd6b-ff67-41f6-b33d-dad96e25ec98 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:57.904053 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d381cd6b-ff67-41f6-b33d-dad96e25ec98 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:57.911015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d381cd6b-ff67-41f6-b33d-dad96e25ec98 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077582 Jul 28 03:50:57.911568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 814/1218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:57 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:58.927414 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2cb8545a-2f73-4d1f-89e2-291e1ce25b4b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:58.928031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2cb8545a-2f73-4d1f-89e2-291e1ce25b4b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:50:58.934178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cb8545a-2f73-4d1f-89e2-291e1ce25b4b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:58.934609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cb8545a-2f73-4d1f-89e2-291e1ce25b4b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:58.935360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cb8545a-2f73-4d1f-89e2-291e1ce25b4b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:50:58.935818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cb8545a-2f73-4d1f-89e2-291e1ce25b4b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:50:58.994621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2cb8545a-2f73-4d1f-89e2-291e1ce25b4b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:59.001993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2cb8545a-2f73-4d1f-89e2-291e1ce25b4b tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078177 Jul 28 03:50:59.002586 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 815/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:50:58 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:00.018196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5be567d1-e616-4af5-a378-f2a7a00003f2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:00.018817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5be567d1-e616-4af5-a378-f2a7a00003f2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:00.025899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5be567d1-e616-4af5-a378-f2a7a00003f2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:00.026349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5be567d1-e616-4af5-a378-f2a7a00003f2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:00.027120 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5be567d1-e616-4af5-a378-f2a7a00003f2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:00.027552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5be567d1-e616-4af5-a378-f2a7a00003f2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:00.086507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5be567d1-e616-4af5-a378-f2a7a00003f2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:00.093789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5be567d1-e616-4af5-a378-f2a7a00003f2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079222 Jul 28 03:51:00.094343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 816/1220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:00 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:01.111365 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dfa22354-033f-4fdb-bacd-16b7161550c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:01.112049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dfa22354-033f-4fdb-bacd-16b7161550c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:01.117982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfa22354-033f-4fdb-bacd-16b7161550c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:01.118423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfa22354-033f-4fdb-bacd-16b7161550c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:01.119197 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfa22354-033f-4fdb-bacd-16b7161550c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:01.119629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfa22354-033f-4fdb-bacd-16b7161550c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:01.177758 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dfa22354-033f-4fdb-bacd-16b7161550c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:01.185122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dfa22354-033f-4fdb-bacd-16b7161550c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077490 Jul 28 03:51:01.185684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 817/1221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:01 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:02.202560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5a6eadf8-6e39-4d61-b3e3-ddd72c53ebd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:02.203542 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5a6eadf8-6e39-4d61-b3e3-ddd72c53ebd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:02.210000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a6eadf8-6e39-4d61-b3e3-ddd72c53ebd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:02.210459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a6eadf8-6e39-4d61-b3e3-ddd72c53ebd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:02.211259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a6eadf8-6e39-4d61-b3e3-ddd72c53ebd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:02.211696 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a6eadf8-6e39-4d61-b3e3-ddd72c53ebd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:02.275680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5a6eadf8-6e39-4d61-b3e3-ddd72c53ebd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:02.283027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5a6eadf8-6e39-4d61-b3e3-ddd72c53ebd2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.084254 Jul 28 03:51:02.283571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 818/1222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:02 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:03.299660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eee9e4f6-6f9c-426d-a810-6c1acb2a97db tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:03.300292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eee9e4f6-6f9c-426d-a810-6c1acb2a97db tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:03.306595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eee9e4f6-6f9c-426d-a810-6c1acb2a97db tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:03.307040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eee9e4f6-6f9c-426d-a810-6c1acb2a97db tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:03.307861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eee9e4f6-6f9c-426d-a810-6c1acb2a97db tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:03.308290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eee9e4f6-6f9c-426d-a810-6c1acb2a97db tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:03.366844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eee9e4f6-6f9c-426d-a810-6c1acb2a97db tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:03.374069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eee9e4f6-6f9c-426d-a810-6c1acb2a97db tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078185 Jul 28 03:51:03.374615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 819/1223] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:03 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:04.391772 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-24b60103-f57c-4c4c-96e1-1f193353e30a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:04.392387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-24b60103-f57c-4c4c-96e1-1f193353e30a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:04.399493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24b60103-f57c-4c4c-96e1-1f193353e30a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:04.400021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24b60103-f57c-4c4c-96e1-1f193353e30a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:04.401013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24b60103-f57c-4c4c-96e1-1f193353e30a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:04.401556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24b60103-f57c-4c4c-96e1-1f193353e30a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:04.459509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-24b60103-f57c-4c4c-96e1-1f193353e30a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:04.467502 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-24b60103-f57c-4c4c-96e1-1f193353e30a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079726 Jul 28 03:51:04.468112 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 820/1224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:04 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:05.484845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8abda70e-08d9-4d03-a7dd-43ad33714c70 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:05.485444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8abda70e-08d9-4d03-a7dd-43ad33714c70 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:05.491216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8abda70e-08d9-4d03-a7dd-43ad33714c70 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:05.491668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8abda70e-08d9-4d03-a7dd-43ad33714c70 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:05.492469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8abda70e-08d9-4d03-a7dd-43ad33714c70 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:05.492906 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8abda70e-08d9-4d03-a7dd-43ad33714c70 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:05.551638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8abda70e-08d9-4d03-a7dd-43ad33714c70 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:05.558991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8abda70e-08d9-4d03-a7dd-43ad33714c70 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077860 Jul 28 03:51:05.559554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 821/1225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:05 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:06.575547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-49230fd1-3073-4671-8cc5-35fa6162bd13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:06.576179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-49230fd1-3073-4671-8cc5-35fa6162bd13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:06.581829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49230fd1-3073-4671-8cc5-35fa6162bd13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:06.582269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49230fd1-3073-4671-8cc5-35fa6162bd13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:06.583024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49230fd1-3073-4671-8cc5-35fa6162bd13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:06.583454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-49230fd1-3073-4671-8cc5-35fa6162bd13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:06.643565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-49230fd1-3073-4671-8cc5-35fa6162bd13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:06.655850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-49230fd1-3073-4671-8cc5-35fa6162bd13 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079220 Jul 28 03:51:06.655850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 822/1226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:06 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:07.667852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-56f8e7b2-3d56-4ef1-8205-a6de4953040c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:07.668487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-56f8e7b2-3d56-4ef1-8205-a6de4953040c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:07.674166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-56f8e7b2-3d56-4ef1-8205-a6de4953040c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:07.674622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-56f8e7b2-3d56-4ef1-8205-a6de4953040c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:07.675474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-56f8e7b2-3d56-4ef1-8205-a6de4953040c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:07.675854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-56f8e7b2-3d56-4ef1-8205-a6de4953040c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:07.735772 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-56f8e7b2-3d56-4ef1-8205-a6de4953040c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:07.744040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-56f8e7b2-3d56-4ef1-8205-a6de4953040c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079734 Jul 28 03:51:07.744685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 823/1227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:07 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:08.771877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b28c268b-7897-4c01-be03-464bad814954 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:08.771877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b28c268b-7897-4c01-be03-464bad814954 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:08.772792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b28c268b-7897-4c01-be03-464bad814954 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:08.772977 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b28c268b-7897-4c01-be03-464bad814954 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:08.774290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b28c268b-7897-4c01-be03-464bad814954 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:08.774726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b28c268b-7897-4c01-be03-464bad814954 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:08.839269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b28c268b-7897-4c01-be03-464bad814954 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:08.846642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b28c268b-7897-4c01-be03-464bad814954 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.084291 Jul 28 03:51:08.847205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 824/1228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:08 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:09.862932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-85713892-1e42-4bbc-a087-4fb7738e15c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:09.863610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-85713892-1e42-4bbc-a087-4fb7738e15c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:09.869522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85713892-1e42-4bbc-a087-4fb7738e15c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:09.869968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85713892-1e42-4bbc-a087-4fb7738e15c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:09.870727 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85713892-1e42-4bbc-a087-4fb7738e15c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:09.871154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85713892-1e42-4bbc-a087-4fb7738e15c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:09.931292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-85713892-1e42-4bbc-a087-4fb7738e15c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:09.938553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-85713892-1e42-4bbc-a087-4fb7738e15c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079295 Jul 28 03:51:09.939099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 825/1229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:09 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:10.955425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f496a87f-ec19-4c3d-b611-490ca0e866c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:10.956059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f496a87f-ec19-4c3d-b611-490ca0e866c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:10.962438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f496a87f-ec19-4c3d-b611-490ca0e866c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:10.962996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f496a87f-ec19-4c3d-b611-490ca0e866c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:10.963789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f496a87f-ec19-4c3d-b611-490ca0e866c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:10.964223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f496a87f-ec19-4c3d-b611-490ca0e866c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:11.023925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f496a87f-ec19-4c3d-b611-490ca0e866c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:11.031153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f496a87f-ec19-4c3d-b611-490ca0e866c6 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079374 Jul 28 03:51:11.031714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 826/1230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:10 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:12.047987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e86e23b2-0b3e-4a44-8ad2-e243a9a2f9c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:12.049065 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e86e23b2-0b3e-4a44-8ad2-e243a9a2f9c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:12.055050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e86e23b2-0b3e-4a44-8ad2-e243a9a2f9c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:12.055750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e86e23b2-0b3e-4a44-8ad2-e243a9a2f9c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:12.056540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e86e23b2-0b3e-4a44-8ad2-e243a9a2f9c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:12.056978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e86e23b2-0b3e-4a44-8ad2-e243a9a2f9c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:12.116858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e86e23b2-0b3e-4a44-8ad2-e243a9a2f9c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:12.124182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e86e23b2-0b3e-4a44-8ad2-e243a9a2f9c5 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079774 Jul 28 03:51:12.124862 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 827/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:12 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:13.140703 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-470bcf3c-76b0-4d00-8877-95c771e48861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:13.141311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-470bcf3c-76b0-4d00-8877-95c771e48861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:13.147281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-470bcf3c-76b0-4d00-8877-95c771e48861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:13.147747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-470bcf3c-76b0-4d00-8877-95c771e48861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:13.148505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-470bcf3c-76b0-4d00-8877-95c771e48861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:13.148939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-470bcf3c-76b0-4d00-8877-95c771e48861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:13.207217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-470bcf3c-76b0-4d00-8877-95c771e48861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:13.214556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-470bcf3c-76b0-4d00-8877-95c771e48861 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077459 Jul 28 03:51:13.215112 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 828/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:13 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:14.232128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0ca7f903-b157-458e-9a3e-433ca41d3628 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:14.232739 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0ca7f903-b157-458e-9a3e-433ca41d3628 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:14.238372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0ca7f903-b157-458e-9a3e-433ca41d3628 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:14.238814 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0ca7f903-b157-458e-9a3e-433ca41d3628 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:14.239571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0ca7f903-b157-458e-9a3e-433ca41d3628 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:14.240025 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0ca7f903-b157-458e-9a3e-433ca41d3628 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:14.299795 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0ca7f903-b157-458e-9a3e-433ca41d3628 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:14.307288 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0ca7f903-b157-458e-9a3e-433ca41d3628 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078896 Jul 28 03:51:14.307872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 829/1233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:14 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:15.324556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-539f9d7f-f233-4e26-a03a-9ffc0bf3b116 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:15.325191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-539f9d7f-f233-4e26-a03a-9ffc0bf3b116 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:15.330956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-539f9d7f-f233-4e26-a03a-9ffc0bf3b116 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:15.331403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-539f9d7f-f233-4e26-a03a-9ffc0bf3b116 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:15.332205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-539f9d7f-f233-4e26-a03a-9ffc0bf3b116 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:15.332637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-539f9d7f-f233-4e26-a03a-9ffc0bf3b116 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:15.394282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-539f9d7f-f233-4e26-a03a-9ffc0bf3b116 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:15.401649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-539f9d7f-f233-4e26-a03a-9ffc0bf3b116 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080840 Jul 28 03:51:15.402204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 830/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:15 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:16.417898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2ec396d1-2aea-4904-82fa-a4cba465b3da tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:16.418515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2ec396d1-2aea-4904-82fa-a4cba465b3da tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:16.424347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ec396d1-2aea-4904-82fa-a4cba465b3da tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:16.424791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ec396d1-2aea-4904-82fa-a4cba465b3da tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:16.425544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ec396d1-2aea-4904-82fa-a4cba465b3da tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:16.425969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ec396d1-2aea-4904-82fa-a4cba465b3da tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:16.484204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2ec396d1-2aea-4904-82fa-a4cba465b3da tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:16.491462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2ec396d1-2aea-4904-82fa-a4cba465b3da tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077084 Jul 28 03:51:16.491991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 831/1235] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:16 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:17.508180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5dbd1c13-6019-4daa-ac48-c5f7a6987978 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:17.508721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5dbd1c13-6019-4daa-ac48-c5f7a6987978 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:17.514551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5dbd1c13-6019-4daa-ac48-c5f7a6987978 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:17.514997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5dbd1c13-6019-4daa-ac48-c5f7a6987978 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:17.515785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5dbd1c13-6019-4daa-ac48-c5f7a6987978 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:17.516220 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5dbd1c13-6019-4daa-ac48-c5f7a6987978 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:17.575140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5dbd1c13-6019-4daa-ac48-c5f7a6987978 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:17.582400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5dbd1c13-6019-4daa-ac48-c5f7a6987978 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078069 Jul 28 03:51:17.582960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 832/1236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:17 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:18.600788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1507a0f7-abea-4fc1-a04d-1f2122813aa8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:18.601480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1507a0f7-abea-4fc1-a04d-1f2122813aa8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:18.607274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1507a0f7-abea-4fc1-a04d-1f2122813aa8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:18.607751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1507a0f7-abea-4fc1-a04d-1f2122813aa8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:18.608509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1507a0f7-abea-4fc1-a04d-1f2122813aa8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:18.608949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1507a0f7-abea-4fc1-a04d-1f2122813aa8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:18.668304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1507a0f7-abea-4fc1-a04d-1f2122813aa8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:18.675392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1507a0f7-abea-4fc1-a04d-1f2122813aa8 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079106 Jul 28 03:51:18.675993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 833/1237] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:18 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:19.692923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4fd6adbb-6dea-455c-9a15-eb446d4f360c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:19.693570 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4fd6adbb-6dea-455c-9a15-eb446d4f360c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:19.699915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fd6adbb-6dea-455c-9a15-eb446d4f360c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:19.700359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fd6adbb-6dea-455c-9a15-eb446d4f360c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:19.701121 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fd6adbb-6dea-455c-9a15-eb446d4f360c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:19.701555 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fd6adbb-6dea-455c-9a15-eb446d4f360c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:19.759804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4fd6adbb-6dea-455c-9a15-eb446d4f360c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:19.766930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4fd6adbb-6dea-455c-9a15-eb446d4f360c tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077735 Jul 28 03:51:19.767481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 834/1238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:19 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:20.783851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ea3d59bb-64b2-4cc7-8b83-465a8784f681 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:20.784510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ea3d59bb-64b2-4cc7-8b83-465a8784f681 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:20.790308 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea3d59bb-64b2-4cc7-8b83-465a8784f681 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:20.790751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea3d59bb-64b2-4cc7-8b83-465a8784f681 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:20.791509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea3d59bb-64b2-4cc7-8b83-465a8784f681 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:20.791972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea3d59bb-64b2-4cc7-8b83-465a8784f681 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:20.850275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ea3d59bb-64b2-4cc7-8b83-465a8784f681 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:20.857645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ea3d59bb-64b2-4cc7-8b83-465a8784f681 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077411 Jul 28 03:51:20.858196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 835/1239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:20 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:21.873972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fa6cdbe4-77d4-4939-998c-0c82811758e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:21.874590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fa6cdbe4-77d4-4939-998c-0c82811758e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:21.880426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa6cdbe4-77d4-4939-998c-0c82811758e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:21.880899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa6cdbe4-77d4-4939-998c-0c82811758e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:21.881649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa6cdbe4-77d4-4939-998c-0c82811758e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:21.882086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa6cdbe4-77d4-4939-998c-0c82811758e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:21.944515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fa6cdbe4-77d4-4939-998c-0c82811758e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:21.952111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fa6cdbe4-77d4-4939-998c-0c82811758e1 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.081716 Jul 28 03:51:21.952678 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 836/1240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:21 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:22.969473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-302e3a33-751e-4803-a238-19417183478e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:22.970078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-302e3a33-751e-4803-a238-19417183478e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:22.976640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-302e3a33-751e-4803-a238-19417183478e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:22.977101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-302e3a33-751e-4803-a238-19417183478e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:22.977839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-302e3a33-751e-4803-a238-19417183478e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:22.978264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-302e3a33-751e-4803-a238-19417183478e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:23.037070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-302e3a33-751e-4803-a238-19417183478e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:23.044961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-302e3a33-751e-4803-a238-19417183478e tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079161 Jul 28 03:51:23.045506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 837/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:22 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:24.061892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cf0cfc1d-2cb9-4ea2-86bc-2101df873eaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:24.062498 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cf0cfc1d-2cb9-4ea2-86bc-2101df873eaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:24.068140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf0cfc1d-2cb9-4ea2-86bc-2101df873eaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:24.068582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf0cfc1d-2cb9-4ea2-86bc-2101df873eaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:24.069337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf0cfc1d-2cb9-4ea2-86bc-2101df873eaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:24.070465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf0cfc1d-2cb9-4ea2-86bc-2101df873eaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:24.129694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cf0cfc1d-2cb9-4ea2-86bc-2101df873eaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:24.137618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cf0cfc1d-2cb9-4ea2-86bc-2101df873eaa tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.079278 Jul 28 03:51:24.138181 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 838/1242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:24 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:25.154576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-df49c69f-70fe-4570-8ce5-378a0fba85ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:25.155220 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-df49c69f-70fe-4570-8ce5-378a0fba85ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:25.160954 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df49c69f-70fe-4570-8ce5-378a0fba85ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:25.161395 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df49c69f-70fe-4570-8ce5-378a0fba85ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:25.162147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df49c69f-70fe-4570-8ce5-378a0fba85ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:25.162613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df49c69f-70fe-4570-8ce5-378a0fba85ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:25.222284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-df49c69f-70fe-4570-8ce5-378a0fba85ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:25.229974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-df49c69f-70fe-4570-8ce5-378a0fba85ca tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078951 Jul 28 03:51:25.230537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 839/1243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:25 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:26.247467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-374c68be-7757-43cf-b3fe-2c241019499a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:26.248088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-374c68be-7757-43cf-b3fe-2c241019499a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:26.253696 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-374c68be-7757-43cf-b3fe-2c241019499a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:26.254136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-374c68be-7757-43cf-b3fe-2c241019499a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:26.254890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-374c68be-7757-43cf-b3fe-2c241019499a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:26.255318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-374c68be-7757-43cf-b3fe-2c241019499a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:26.314558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-374c68be-7757-43cf-b3fe-2c241019499a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:26.322578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-374c68be-7757-43cf-b3fe-2c241019499a tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078774 Jul 28 03:51:26.323129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 840/1244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:26 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:27.339786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6bd608ff-ab09-4d1e-941f-941aa2dc51c7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:27.340411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6bd608ff-ab09-4d1e-941f-941aa2dc51c7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:27.346071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6bd608ff-ab09-4d1e-941f-941aa2dc51c7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:27.346511 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6bd608ff-ab09-4d1e-941f-941aa2dc51c7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:27.347262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6bd608ff-ab09-4d1e-941f-941aa2dc51c7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:27.347693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6bd608ff-ab09-4d1e-941f-941aa2dc51c7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:27.407587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6bd608ff-ab09-4d1e-941f-941aa2dc51c7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:27.415340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6bd608ff-ab09-4d1e-941f-941aa2dc51c7 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.080011 Jul 28 03:51:27.415932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 841/1245] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:27 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:28.432418 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b5755654-6608-4560-90a7-934ae3bd4887 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:28.433072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b5755654-6608-4560-90a7-934ae3bd4887 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:28.439090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b5755654-6608-4560-90a7-934ae3bd4887 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:28.439530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b5755654-6608-4560-90a7-934ae3bd4887 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:28.440333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b5755654-6608-4560-90a7-934ae3bd4887 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:28.440767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b5755654-6608-4560-90a7-934ae3bd4887 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:28.502562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b5755654-6608-4560-90a7-934ae3bd4887 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:28.509875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b5755654-6608-4560-90a7-934ae3bd4887 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.081769 Jul 28 03:51:28.510432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 842/1246] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:28 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:29.526649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5abf6628-6eee-4425-bbdd-ccf336e72464 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:29.527272 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5abf6628-6eee-4425-bbdd-ccf336e72464 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:29.533055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5abf6628-6eee-4425-bbdd-ccf336e72464 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:29.533501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5abf6628-6eee-4425-bbdd-ccf336e72464 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:29.534259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5abf6628-6eee-4425-bbdd-ccf336e72464 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:29.534690 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5abf6628-6eee-4425-bbdd-ccf336e72464 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:29.593204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5abf6628-6eee-4425-bbdd-ccf336e72464 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:29.601351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5abf6628-6eee-4425-bbdd-ccf336e72464 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077947 Jul 28 03:51:29.602007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 843/1247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:29 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:30.617709 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4546d2bd-d0cd-4918-9c6d-09e05a8cfdeb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:30.618372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4546d2bd-d0cd-4918-9c6d-09e05a8cfdeb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:30.624188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4546d2bd-d0cd-4918-9c6d-09e05a8cfdeb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:30.624632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4546d2bd-d0cd-4918-9c6d-09e05a8cfdeb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:30.625391 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4546d2bd-d0cd-4918-9c6d-09e05a8cfdeb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:30.625823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4546d2bd-d0cd-4918-9c6d-09e05a8cfdeb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:30.684392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4546d2bd-d0cd-4918-9c6d-09e05a8cfdeb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:30.691485 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4546d2bd-d0cd-4918-9c6d-09e05a8cfdeb tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.077634 Jul 28 03:51:30.692070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 844/1248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:30 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:31.708929 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-28582f34-eb87-4182-aaf3-a1fcc5f45804 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:31.709583 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-28582f34-eb87-4182-aaf3-a1fcc5f45804 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:31.716133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28582f34-eb87-4182-aaf3-a1fcc5f45804 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:31.716575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28582f34-eb87-4182-aaf3-a1fcc5f45804 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:31.717326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28582f34-eb87-4182-aaf3-a1fcc5f45804 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:31.717756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28582f34-eb87-4182-aaf3-a1fcc5f45804 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:31.776699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-28582f34-eb87-4182-aaf3-a1fcc5f45804 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:31.783834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-28582f34-eb87-4182-aaf3-a1fcc5f45804 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1219 microversion: 2.1 time: 0.078642 Jul 28 03:51:31.784387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 845/1249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:31 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:32.801429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:32.802033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:32.808389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:32.808837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:32.809796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:32.810232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:32.841223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:32.842084 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:32.842637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lazy-loading 'fault' on Instance uuid cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:51:32.885282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b539456ade66487fabf02e41879bbb45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcfeb19e3a6d42cfbf29ba7e9a7aeacf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:32.891981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a6dc1609-35a1-4790-8f9f-2c8ab9f9d4e4 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 200 len: 1267 microversion: 2.1 time: 0.094197 Jul 28 03:51:32.892547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 846/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:32 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:33.909577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0ac4747d-76e9-4e9c-8468-3385d31f3fc2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:33.910237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0ac4747d-76e9-4e9c-8468-3385d31f3fc2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] [instance: cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:51:33.916103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0ac4747d-76e9-4e9c-8468-3385d31f3fc2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:33.916558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0ac4747d-76e9-4e9c-8468-3385d31f3fc2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:33.917327 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0ac4747d-76e9-4e9c-8468-3385d31f3fc2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:51:33.917763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0ac4747d-76e9-4e9c-8468-3385d31f3fc2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:51:33.931177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-0ac4747d-76e9-4e9c-8468-3385d31f3fc2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] HTTP exception thrown: Instance cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e could not be found. Jul 28 03:51:33.931778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0ac4747d-76e9-4e9c-8468-3385d31f3fc2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Returning 404 to user: Instance cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:51:33.932588 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0ac4747d-76e9-4e9c-8468-3385d31f3fc2 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e" status: 404 len: 111 microversion: 2.1 time: 0.026715 Jul 28 03:51:33.933100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 847/1251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:51:33 2021] GET /compute/v2.1/servers/cb1d0d1b-6271-43ee-bd47-4c5d2de12a7e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:51:34.091104 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-58aa1c22-b6d8-4767-a1d5-60df13643aa0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] Calling method '.version_select at 0x7f68068cfaf0>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:34.112007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-58aa1c22-b6d8-4767-a1d5-60df13643aa0 tempest-TestShelveInstance-1514096497 tempest-TestShelveInstance-1514096497-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-450332115" status: 202 len: 0 microversion: 2.1 time: 0.024072 Jul 28 03:51:34.112884 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 848/1252] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Jul 28 03:51:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-450332115 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:52:15.012729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:52:15.013331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 03:52:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 03:52:38.784948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 03:52:38.790295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cdf4f67e-f205-464b-953c-d4aedb28c95d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:38.790917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cdf4f67e-f205-464b-953c-d4aedb28c95d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:38.798030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cdf4f67e-f205-464b-953c-d4aedb28c95d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:38.798477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cdf4f67e-f205-464b-953c-d4aedb28c95d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:38.799270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cdf4f67e-f205-464b-953c-d4aedb28c95d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:38.799738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cdf4f67e-f205-464b-953c-d4aedb28c95d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:38.823517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cdf4f67e-f205-464b-953c-d4aedb28c95d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:52:38.897536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cdf4f67e-f205-464b-953c-d4aedb28c95d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 204 len: 0 microversion: 2.1 time: 0.114505 Jul 28 03:52:38.898100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 849/1253] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:52:38 2021] DELETE /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:52:38.906259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a73c846e-6720-462b-a5d3-25df77a9ee13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:38.906953 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a73c846e-6720-462b-a5d3-25df77a9ee13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:38.913051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a73c846e-6720-462b-a5d3-25df77a9ee13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:38.913495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a73c846e-6720-462b-a5d3-25df77a9ee13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:38.914261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a73c846e-6720-462b-a5d3-25df77a9ee13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:38.914693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a73c846e-6720-462b-a5d3-25df77a9ee13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:39.171232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a73c846e-6720-462b-a5d3-25df77a9ee13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:39.179635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a73c846e-6720-462b-a5d3-25df77a9ee13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1719 microversion: 2.1 time: 0.277215 Jul 28 03:52:39.180207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 850/1254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:38 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1719 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:40.197894 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4bbaec90-8de3-4139-9356-61cae523e70f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:40.198578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4bbaec90-8de3-4139-9356-61cae523e70f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:40.216596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4bbaec90-8de3-4139-9356-61cae523e70f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:40.217072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4bbaec90-8de3-4139-9356-61cae523e70f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:40.217859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4bbaec90-8de3-4139-9356-61cae523e70f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:40.218297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4bbaec90-8de3-4139-9356-61cae523e70f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:40.223837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35392. Jul 28 03:52:40.347364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4bbaec90-8de3-4139-9356-61cae523e70f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:40.355404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4bbaec90-8de3-4139-9356-61cae523e70f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1719 microversion: 2.1 time: 0.161254 Jul 28 03:52:40.355991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 851/1255] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:40 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:40.860393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-b554fa24-dcbb-4d3d-b0c4-2221d73e4888 req-a1260460-4324-4401-b241-f522f5dbd775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0eb74a9-c89c-4863-9431-4de9be74c41c", "name": "network-vif-deleted", "tag": "e78fba6c-176b-4f20-8246-8712019f721a"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:40.862158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:40.862158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:52:40.870851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-b554fa24-dcbb-4d3d-b0c4-2221d73e4888 req-a1260460-4324-4401-b241-f522f5dbd775 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:40.871565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-b554fa24-dcbb-4d3d-b0c4-2221d73e4888 req-a1260460-4324-4401-b241-f522f5dbd775 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:40.900237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-b554fa24-dcbb-4d3d-b0c4-2221d73e4888 req-a1260460-4324-4401-b241-f522f5dbd775 service nova] Creating event network-vif-deleted:e78fba6c-176b-4f20-8246-8712019f721a for instance c0eb74a9-c89c-4863-9431-4de9be74c41c on hv-cinder-73306 Jul 28 03:52:40.906320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-b554fa24-dcbb-4d3d-b0c4-2221d73e4888 req-a1260460-4324-4401-b241-f522f5dbd775 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049773 Jul 28 03:52:40.907139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 852/1256] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:52:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:41.373444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-842b3a7f-83f2-468c-84fa-56e53010e263 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:41.374146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-842b3a7f-83f2-468c-84fa-56e53010e263 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:41.380341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-842b3a7f-83f2-468c-84fa-56e53010e263 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:41.380958 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-842b3a7f-83f2-468c-84fa-56e53010e263 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:41.381738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-842b3a7f-83f2-468c-84fa-56e53010e263 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:41.382198 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-842b3a7f-83f2-468c-84fa-56e53010e263 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:41.443066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-842b3a7f-83f2-468c-84fa-56e53010e263 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:41.451270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-842b3a7f-83f2-468c-84fa-56e53010e263 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082016 Jul 28 03:52:41.451853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 853/1257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:41 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:42.468504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-419628b8-1d14-4079-98de-19c02d20c8d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:42.469152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-419628b8-1d14-4079-98de-19c02d20c8d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:42.476133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-419628b8-1d14-4079-98de-19c02d20c8d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:42.476584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-419628b8-1d14-4079-98de-19c02d20c8d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:42.477349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-419628b8-1d14-4079-98de-19c02d20c8d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:42.477784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-419628b8-1d14-4079-98de-19c02d20c8d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:42.537090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-419628b8-1d14-4079-98de-19c02d20c8d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:42.544763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-419628b8-1d14-4079-98de-19c02d20c8d5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079932 Jul 28 03:52:42.545345 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 854/1258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:42 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:43.562902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-73812522-9797-41ed-90b4-60372c2451bd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:43.563571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-73812522-9797-41ed-90b4-60372c2451bd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:43.569839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73812522-9797-41ed-90b4-60372c2451bd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:43.570276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73812522-9797-41ed-90b4-60372c2451bd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:43.571038 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73812522-9797-41ed-90b4-60372c2451bd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:43.571460 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73812522-9797-41ed-90b4-60372c2451bd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:43.631176 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-73812522-9797-41ed-90b4-60372c2451bd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:43.639034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-73812522-9797-41ed-90b4-60372c2451bd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079635 Jul 28 03:52:43.639544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 855/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:43 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:44.013666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8e0a4b9a-e2f5-4a1b-a555-faabc18a4cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:44.014163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8e0a4b9a-e2f5-4a1b-a555-faabc18a4cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:44.020099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e0a4b9a-e2f5-4a1b-a555-faabc18a4cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:44.020551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e0a4b9a-e2f5-4a1b-a555-faabc18a4cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:44.021337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e0a4b9a-e2f5-4a1b-a555-faabc18a4cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:44.021762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e0a4b9a-e2f5-4a1b-a555-faabc18a4cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:44.046159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8e0a4b9a-e2f5-4a1b-a555-faabc18a4cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:52:44.119896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8e0a4b9a-e2f5-4a1b-a555-faabc18a4cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 204 len: 0 microversion: 2.1 time: 0.109533 Jul 28 03:52:44.123515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 856/1260] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:52:44 2021] DELETE /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:52:44.129212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-23439976-65e8-466d-932a-24ed7898ff67 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:44.129910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-23439976-65e8-466d-932a-24ed7898ff67 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:44.135923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-23439976-65e8-466d-932a-24ed7898ff67 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:44.136374 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-23439976-65e8-466d-932a-24ed7898ff67 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:44.137145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-23439976-65e8-466d-932a-24ed7898ff67 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:44.137714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-23439976-65e8-466d-932a-24ed7898ff67 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:44.261303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-23439976-65e8-466d-932a-24ed7898ff67 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:44.268864 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-23439976-65e8-466d-932a-24ed7898ff67 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1560 microversion: 2.1 time: 0.143699 Jul 28 03:52:44.269430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 857/1261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:44 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:44.656168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7a47c10c-5dac-4867-9ce5-e436a4ac9511 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:44.656803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7a47c10c-5dac-4867-9ce5-e436a4ac9511 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:44.662618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a47c10c-5dac-4867-9ce5-e436a4ac9511 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:44.663147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a47c10c-5dac-4867-9ce5-e436a4ac9511 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:44.663944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a47c10c-5dac-4867-9ce5-e436a4ac9511 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:44.664381 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a47c10c-5dac-4867-9ce5-e436a4ac9511 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:44.724829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7a47c10c-5dac-4867-9ce5-e436a4ac9511 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:44.732759 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7a47c10c-5dac-4867-9ce5-e436a4ac9511 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.080285 Jul 28 03:52:44.733319 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 858/1262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:44 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:45.286200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9036070b-060e-410e-8e72-c15e9f04b9ff tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:45.287330 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9036070b-060e-410e-8e72-c15e9f04b9ff tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:45.293537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9036070b-060e-410e-8e72-c15e9f04b9ff tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:45.294046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9036070b-060e-410e-8e72-c15e9f04b9ff tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:45.294826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9036070b-060e-410e-8e72-c15e9f04b9ff tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:45.295692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9036070b-060e-410e-8e72-c15e9f04b9ff tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:45.357621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9036070b-060e-410e-8e72-c15e9f04b9ff tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:45.366071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9036070b-060e-410e-8e72-c15e9f04b9ff tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1518 microversion: 2.1 time: 0.083591 Jul 28 03:52:45.366640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 859/1263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:45 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1518 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:45.370914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-c562c206-4080-4948-8fb5-6271ab278dc4 req-01bf8531-33f1-4354-9881-aa2a472cfc52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6defc507-3456-460c-94f0-1d954af7997d", "name": "network-vif-deleted", "tag": "00ec2991-6499-46ee-92c3-65a3dcb24629"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:45.372478 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:45.372478 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:52:45.378699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-c562c206-4080-4948-8fb5-6271ab278dc4 req-01bf8531-33f1-4354-9881-aa2a472cfc52 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:45.379141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-c562c206-4080-4948-8fb5-6271ab278dc4 req-01bf8531-33f1-4354-9881-aa2a472cfc52 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:45.390231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-c562c206-4080-4948-8fb5-6271ab278dc4 req-01bf8531-33f1-4354-9881-aa2a472cfc52 service nova] Creating event network-vif-deleted:00ec2991-6499-46ee-92c3-65a3dcb24629 for instance 6defc507-3456-460c-94f0-1d954af7997d on hv-cinder-73306 Jul 28 03:52:45.394708 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-c562c206-4080-4948-8fb5-6271ab278dc4 req-01bf8531-33f1-4354-9881-aa2a472cfc52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026994 Jul 28 03:52:45.395249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 860/1264] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:52:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:45.750517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c49c953e-6dda-4f72-a1eb-b22fdd690fc5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:45.751257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c49c953e-6dda-4f72-a1eb-b22fdd690fc5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:45.758026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c49c953e-6dda-4f72-a1eb-b22fdd690fc5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:45.758471 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c49c953e-6dda-4f72-a1eb-b22fdd690fc5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:45.759230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c49c953e-6dda-4f72-a1eb-b22fdd690fc5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:45.759690 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c49c953e-6dda-4f72-a1eb-b22fdd690fc5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:45.818770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c49c953e-6dda-4f72-a1eb-b22fdd690fc5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:45.826356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c49c953e-6dda-4f72-a1eb-b22fdd690fc5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.080521 Jul 28 03:52:45.826901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 861/1265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:45 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:46.383180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e50fbb13-a432-4f5e-9439-29732fe3c045 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:46.383852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e50fbb13-a432-4f5e-9439-29732fe3c045 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:46.389818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e50fbb13-a432-4f5e-9439-29732fe3c045 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:46.390285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e50fbb13-a432-4f5e-9439-29732fe3c045 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:46.391084 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e50fbb13-a432-4f5e-9439-29732fe3c045 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:46.391521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e50fbb13-a432-4f5e-9439-29732fe3c045 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:46.450090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e50fbb13-a432-4f5e-9439-29732fe3c045 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:46.457790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e50fbb13-a432-4f5e-9439-29732fe3c045 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078583 Jul 28 03:52:46.458380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 862/1266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:46 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:46.842267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dfc88cec-299e-4999-a588-f6e9967f45a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:46.842919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dfc88cec-299e-4999-a588-f6e9967f45a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:46.848623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfc88cec-299e-4999-a588-f6e9967f45a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:46.849654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfc88cec-299e-4999-a588-f6e9967f45a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:46.850745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfc88cec-299e-4999-a588-f6e9967f45a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:46.851179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dfc88cec-299e-4999-a588-f6e9967f45a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:46.912970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dfc88cec-299e-4999-a588-f6e9967f45a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:46.920576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dfc88cec-299e-4999-a588-f6e9967f45a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081983 Jul 28 03:52:46.921127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 863/1267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:46 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:47.474837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3af58155-b5a0-476a-809c-4ecdf26de2cf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:47.475660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3af58155-b5a0-476a-809c-4ecdf26de2cf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:47.481657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3af58155-b5a0-476a-809c-4ecdf26de2cf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:47.482104 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3af58155-b5a0-476a-809c-4ecdf26de2cf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:47.482870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3af58155-b5a0-476a-809c-4ecdf26de2cf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:47.483298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3af58155-b5a0-476a-809c-4ecdf26de2cf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:47.542274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3af58155-b5a0-476a-809c-4ecdf26de2cf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:47.549851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3af58155-b5a0-476a-809c-4ecdf26de2cf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079377 Jul 28 03:52:47.550407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 864/1268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:47 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:47.936525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-80ba5fdd-1562-4125-b7d5-b895a9393a10 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:47.937182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-80ba5fdd-1562-4125-b7d5-b895a9393a10 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:47.943385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-80ba5fdd-1562-4125-b7d5-b895a9393a10 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:47.943854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-80ba5fdd-1562-4125-b7d5-b895a9393a10 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:47.944616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-80ba5fdd-1562-4125-b7d5-b895a9393a10 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:47.945051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-80ba5fdd-1562-4125-b7d5-b895a9393a10 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:48.003994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-80ba5fdd-1562-4125-b7d5-b895a9393a10 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:48.012216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-80ba5fdd-1562-4125-b7d5-b895a9393a10 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079304 Jul 28 03:52:48.012771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 865/1269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:47 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:48.566025 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fc6529fd-4ddf-4933-8348-7bb0a1241c95 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:48.566633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fc6529fd-4ddf-4933-8348-7bb0a1241c95 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:48.572716 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc6529fd-4ddf-4933-8348-7bb0a1241c95 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:48.573159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc6529fd-4ddf-4933-8348-7bb0a1241c95 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:48.573919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc6529fd-4ddf-4933-8348-7bb0a1241c95 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:48.574352 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc6529fd-4ddf-4933-8348-7bb0a1241c95 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:48.633354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fc6529fd-4ddf-4933-8348-7bb0a1241c95 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:48.641082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fc6529fd-4ddf-4933-8348-7bb0a1241c95 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078700 Jul 28 03:52:48.641633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 866/1270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:48 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:49.028517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2c73799d-48c6-43c1-9f50-49ee849d9287 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:49.029180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2c73799d-48c6-43c1-9f50-49ee849d9287 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:49.034820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c73799d-48c6-43c1-9f50-49ee849d9287 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:49.035257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c73799d-48c6-43c1-9f50-49ee849d9287 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:49.036036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c73799d-48c6-43c1-9f50-49ee849d9287 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:49.037119 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c73799d-48c6-43c1-9f50-49ee849d9287 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:49.094364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2c73799d-48c6-43c1-9f50-49ee849d9287 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:49.103697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2c73799d-48c6-43c1-9f50-49ee849d9287 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078914 Jul 28 03:52:49.104265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 867/1271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:49 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:49.657573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-03ca61bd-7dfe-4606-a5b0-ba378e3cca84 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:49.658283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-03ca61bd-7dfe-4606-a5b0-ba378e3cca84 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:49.664495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03ca61bd-7dfe-4606-a5b0-ba378e3cca84 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:49.664947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03ca61bd-7dfe-4606-a5b0-ba378e3cca84 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:49.665707 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03ca61bd-7dfe-4606-a5b0-ba378e3cca84 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:49.666187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03ca61bd-7dfe-4606-a5b0-ba378e3cca84 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:49.726751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-03ca61bd-7dfe-4606-a5b0-ba378e3cca84 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:49.734902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-03ca61bd-7dfe-4606-a5b0-ba378e3cca84 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.081149 Jul 28 03:52:49.735534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 868/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:49 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:50.120280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a392d31a-5219-4885-9577-a1cab16040e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:50.120924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a392d31a-5219-4885-9577-a1cab16040e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:50.126731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a392d31a-5219-4885-9577-a1cab16040e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:50.127186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a392d31a-5219-4885-9577-a1cab16040e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:50.127992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a392d31a-5219-4885-9577-a1cab16040e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:50.128433 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a392d31a-5219-4885-9577-a1cab16040e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:50.190765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a392d31a-5219-4885-9577-a1cab16040e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:50.199054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a392d31a-5219-4885-9577-a1cab16040e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082374 Jul 28 03:52:50.199615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 869/1273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:50 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:50.752636 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0a64dd78-6c87-4c43-a7ca-12acdf5c3bbf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:50.753166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0a64dd78-6c87-4c43-a7ca-12acdf5c3bbf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:50.758928 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a64dd78-6c87-4c43-a7ca-12acdf5c3bbf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:50.759370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a64dd78-6c87-4c43-a7ca-12acdf5c3bbf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:50.760159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a64dd78-6c87-4c43-a7ca-12acdf5c3bbf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:50.760586 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a64dd78-6c87-4c43-a7ca-12acdf5c3bbf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:50.818874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0a64dd78-6c87-4c43-a7ca-12acdf5c3bbf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:50.826359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0a64dd78-6c87-4c43-a7ca-12acdf5c3bbf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077496 Jul 28 03:52:50.826907 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 870/1274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:50 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:51.216409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b08e5580-6bc5-4cb1-9287-aeeedcbe610b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:51.217111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b08e5580-6bc5-4cb1-9287-aeeedcbe610b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:51.223002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b08e5580-6bc5-4cb1-9287-aeeedcbe610b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:51.223453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b08e5580-6bc5-4cb1-9287-aeeedcbe610b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:51.224948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b08e5580-6bc5-4cb1-9287-aeeedcbe610b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:51.225680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b08e5580-6bc5-4cb1-9287-aeeedcbe610b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:51.286034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b08e5580-6bc5-4cb1-9287-aeeedcbe610b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:51.294399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b08e5580-6bc5-4cb1-9287-aeeedcbe610b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081616 Jul 28 03:52:51.294898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 871/1275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:51 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:51.842866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3d06d3e7-9600-4e07-b966-c3a3f8e62c1e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:51.843513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3d06d3e7-9600-4e07-b966-c3a3f8e62c1e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:51.849328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d06d3e7-9600-4e07-b966-c3a3f8e62c1e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:51.849770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d06d3e7-9600-4e07-b966-c3a3f8e62c1e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:51.850803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d06d3e7-9600-4e07-b966-c3a3f8e62c1e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:51.851236 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d06d3e7-9600-4e07-b966-c3a3f8e62c1e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:51.909299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3d06d3e7-9600-4e07-b966-c3a3f8e62c1e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:51.916938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3d06d3e7-9600-4e07-b966-c3a3f8e62c1e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077758 Jul 28 03:52:51.917488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 872/1276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:51 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:52.311224 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a34d762e-611e-49c1-b7be-0742506eee22 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:52.311993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a34d762e-611e-49c1-b7be-0742506eee22 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:52.317686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a34d762e-611e-49c1-b7be-0742506eee22 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:52.318123 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a34d762e-611e-49c1-b7be-0742506eee22 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:52.318890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a34d762e-611e-49c1-b7be-0742506eee22 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:52.319317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a34d762e-611e-49c1-b7be-0742506eee22 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:52.378005 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a34d762e-611e-49c1-b7be-0742506eee22 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:52.385955 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a34d762e-611e-49c1-b7be-0742506eee22 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078469 Jul 28 03:52:52.386520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 873/1277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:52 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:52.933389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-83c3460c-1566-4739-9ea4-c2d516883ebf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:52.933997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-83c3460c-1566-4739-9ea4-c2d516883ebf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:52.939771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83c3460c-1566-4739-9ea4-c2d516883ebf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:52.940217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83c3460c-1566-4739-9ea4-c2d516883ebf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:52.940970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83c3460c-1566-4739-9ea4-c2d516883ebf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:52.941397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83c3460c-1566-4739-9ea4-c2d516883ebf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:53.000535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-83c3460c-1566-4739-9ea4-c2d516883ebf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:53.008951 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-83c3460c-1566-4739-9ea4-c2d516883ebf tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079226 Jul 28 03:52:53.009510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 874/1278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:52 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:53.402432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-af669326-5364-4fa5-84e1-cef4f3ede292 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:53.403083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-af669326-5364-4fa5-84e1-cef4f3ede292 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:53.408794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af669326-5364-4fa5-84e1-cef4f3ede292 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:53.409243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af669326-5364-4fa5-84e1-cef4f3ede292 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:53.409993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af669326-5364-4fa5-84e1-cef4f3ede292 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:53.410420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-af669326-5364-4fa5-84e1-cef4f3ede292 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:53.472551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-af669326-5364-4fa5-84e1-cef4f3ede292 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:53.481081 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-af669326-5364-4fa5-84e1-cef4f3ede292 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082296 Jul 28 03:52:53.481630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 875/1279] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:53 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:54.024572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d2fe0062-0784-4426-bc6d-a1c856ecea7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:54.025177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d2fe0062-0784-4426-bc6d-a1c856ecea7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:54.030956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d2fe0062-0784-4426-bc6d-a1c856ecea7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:54.031398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d2fe0062-0784-4426-bc6d-a1c856ecea7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:54.032187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d2fe0062-0784-4426-bc6d-a1c856ecea7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:54.032615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d2fe0062-0784-4426-bc6d-a1c856ecea7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:54.091225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d2fe0062-0784-4426-bc6d-a1c856ecea7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:54.098869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d2fe0062-0784-4426-bc6d-a1c856ecea7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077789 Jul 28 03:52:54.099397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 876/1280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:54 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:54.497599 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e0b9fdb7-d11c-4419-bbdc-df01d6bf413d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:54.498250 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e0b9fdb7-d11c-4419-bbdc-df01d6bf413d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:54.503901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0b9fdb7-d11c-4419-bbdc-df01d6bf413d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:54.504343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0b9fdb7-d11c-4419-bbdc-df01d6bf413d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:54.505257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0b9fdb7-d11c-4419-bbdc-df01d6bf413d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:54.505686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0b9fdb7-d11c-4419-bbdc-df01d6bf413d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:54.564190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e0b9fdb7-d11c-4419-bbdc-df01d6bf413d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:54.571820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e0b9fdb7-d11c-4419-bbdc-df01d6bf413d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.077799 Jul 28 03:52:54.572369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 877/1281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:54 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:55.115716 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-96d301d7-5ff1-42af-868f-34d399f0d190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:55.116365 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-96d301d7-5ff1-42af-868f-34d399f0d190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:55.122139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96d301d7-5ff1-42af-868f-34d399f0d190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:55.122582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96d301d7-5ff1-42af-868f-34d399f0d190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:55.123341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96d301d7-5ff1-42af-868f-34d399f0d190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:55.123802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96d301d7-5ff1-42af-868f-34d399f0d190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:55.185265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-96d301d7-5ff1-42af-868f-34d399f0d190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:55.193857 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-96d301d7-5ff1-42af-868f-34d399f0d190 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.081764 Jul 28 03:52:55.194405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 878/1282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:55 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:55.588247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3b220453-8df3-4ac2-bfac-1f4062e87175 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:55.588864 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3b220453-8df3-4ac2-bfac-1f4062e87175 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:55.594539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b220453-8df3-4ac2-bfac-1f4062e87175 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:55.594988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b220453-8df3-4ac2-bfac-1f4062e87175 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:55.595766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b220453-8df3-4ac2-bfac-1f4062e87175 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:55.596204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3b220453-8df3-4ac2-bfac-1f4062e87175 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:55.654897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3b220453-8df3-4ac2-bfac-1f4062e87175 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:55.662674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3b220453-8df3-4ac2-bfac-1f4062e87175 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.077993 Jul 28 03:52:55.663230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 879/1283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:55 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:56.210910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8c7ce9a2-02af-4f6f-8476-4d6d43a2e38f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:56.211516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8c7ce9a2-02af-4f6f-8476-4d6d43a2e38f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:56.217301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8c7ce9a2-02af-4f6f-8476-4d6d43a2e38f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:56.217744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8c7ce9a2-02af-4f6f-8476-4d6d43a2e38f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:56.218494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8c7ce9a2-02af-4f6f-8476-4d6d43a2e38f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:56.218919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8c7ce9a2-02af-4f6f-8476-4d6d43a2e38f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:56.277774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8c7ce9a2-02af-4f6f-8476-4d6d43a2e38f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:56.285284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8c7ce9a2-02af-4f6f-8476-4d6d43a2e38f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078320 Jul 28 03:52:56.285831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 880/1284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:56 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:56.679957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1b70ee1b-73c0-4756-a6be-6e07675ca9ad tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:56.680609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1b70ee1b-73c0-4756-a6be-6e07675ca9ad tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:56.686234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b70ee1b-73c0-4756-a6be-6e07675ca9ad tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:56.686682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b70ee1b-73c0-4756-a6be-6e07675ca9ad tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:56.687433 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b70ee1b-73c0-4756-a6be-6e07675ca9ad tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:56.687891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1b70ee1b-73c0-4756-a6be-6e07675ca9ad tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:56.750811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1b70ee1b-73c0-4756-a6be-6e07675ca9ad tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:56.760224 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1b70ee1b-73c0-4756-a6be-6e07675ca9ad tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.084155 Jul 28 03:52:56.760834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 881/1285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:56 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:57.303087 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cd487650-9c99-428e-aedb-de60d4d65572 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:57.303698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cd487650-9c99-428e-aedb-de60d4d65572 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:57.309468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd487650-9c99-428e-aedb-de60d4d65572 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:57.309908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd487650-9c99-428e-aedb-de60d4d65572 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:57.310660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd487650-9c99-428e-aedb-de60d4d65572 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:57.311086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cd487650-9c99-428e-aedb-de60d4d65572 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:57.369929 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cd487650-9c99-428e-aedb-de60d4d65572 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:57.377829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cd487650-9c99-428e-aedb-de60d4d65572 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078847 Jul 28 03:52:57.378326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 882/1286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:57 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:57.777125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8a27f8cc-8876-4b96-aa0b-61cb2b7cff33 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:57.777729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8a27f8cc-8876-4b96-aa0b-61cb2b7cff33 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:57.783370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a27f8cc-8876-4b96-aa0b-61cb2b7cff33 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:57.783854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a27f8cc-8876-4b96-aa0b-61cb2b7cff33 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:57.784621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a27f8cc-8876-4b96-aa0b-61cb2b7cff33 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:57.785059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8a27f8cc-8876-4b96-aa0b-61cb2b7cff33 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:57.844159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8a27f8cc-8876-4b96-aa0b-61cb2b7cff33 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:57.852810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8a27f8cc-8876-4b96-aa0b-61cb2b7cff33 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079281 Jul 28 03:52:57.853371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 883/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:57 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:58.394131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1725424c-3fe4-4b7c-a3ae-28a186fe7598 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:58.394741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1725424c-3fe4-4b7c-a3ae-28a186fe7598 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:58.401342 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1725424c-3fe4-4b7c-a3ae-28a186fe7598 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:58.401785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1725424c-3fe4-4b7c-a3ae-28a186fe7598 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:58.402539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1725424c-3fe4-4b7c-a3ae-28a186fe7598 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:58.402974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1725424c-3fe4-4b7c-a3ae-28a186fe7598 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:58.461681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1725424c-3fe4-4b7c-a3ae-28a186fe7598 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:58.469245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1725424c-3fe4-4b7c-a3ae-28a186fe7598 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078742 Jul 28 03:52:58.469793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 884/1288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:58 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:58.870589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9f4d7683-0abd-464e-af06-d208b810148f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:58.871240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9f4d7683-0abd-464e-af06-d208b810148f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:58.877071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f4d7683-0abd-464e-af06-d208b810148f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:58.877519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f4d7683-0abd-464e-af06-d208b810148f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:58.878269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f4d7683-0abd-464e-af06-d208b810148f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:58.878698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f4d7683-0abd-464e-af06-d208b810148f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:58.936578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9f4d7683-0abd-464e-af06-d208b810148f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:58.944309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9f4d7683-0abd-464e-af06-d208b810148f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.077461 Jul 28 03:52:58.944860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 885/1289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:58 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:59.486224 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-120b6819-861f-495a-812e-f9a4e92ee98a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:59.486756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-120b6819-861f-495a-812e-f9a4e92ee98a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:59.492710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-120b6819-861f-495a-812e-f9a4e92ee98a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:59.493152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-120b6819-861f-495a-812e-f9a4e92ee98a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:59.493905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-120b6819-861f-495a-812e-f9a4e92ee98a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:59.494338 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-120b6819-861f-495a-812e-f9a4e92ee98a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:59.553942 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-120b6819-861f-495a-812e-f9a4e92ee98a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:59.561625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-120b6819-861f-495a-812e-f9a4e92ee98a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079095 Jul 28 03:52:59.562178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 886/1290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:59 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:59.961665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9e045dfb-44aa-49b9-85f1-734241e0c77c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:59.962331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9e045dfb-44aa-49b9-85f1-734241e0c77c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:52:59.967972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e045dfb-44aa-49b9-85f1-734241e0c77c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:59.968413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e045dfb-44aa-49b9-85f1-734241e0c77c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:52:59.969167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e045dfb-44aa-49b9-85f1-734241e0c77c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:52:59.969593 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e045dfb-44aa-49b9-85f1-734241e0c77c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:00.032554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9e045dfb-44aa-49b9-85f1-734241e0c77c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:00.040321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9e045dfb-44aa-49b9-85f1-734241e0c77c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.083141 Jul 28 03:53:00.040886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 887/1291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:52:59 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:00.578552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5b144915-15b2-4c7e-98c4-ec05d6b538b8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:00.579287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5b144915-15b2-4c7e-98c4-ec05d6b538b8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:00.585364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b144915-15b2-4c7e-98c4-ec05d6b538b8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:00.585818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b144915-15b2-4c7e-98c4-ec05d6b538b8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:00.586590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b144915-15b2-4c7e-98c4-ec05d6b538b8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:00.587028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b144915-15b2-4c7e-98c4-ec05d6b538b8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:00.645976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5b144915-15b2-4c7e-98c4-ec05d6b538b8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:00.653611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5b144915-15b2-4c7e-98c4-ec05d6b538b8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078670 Jul 28 03:53:00.654167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 888/1292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:00 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:01.057175 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5bdab19f-4de2-41ee-a420-dd3db04005cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:01.057847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5bdab19f-4de2-41ee-a420-dd3db04005cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:01.063549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bdab19f-4de2-41ee-a420-dd3db04005cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:01.064036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bdab19f-4de2-41ee-a420-dd3db04005cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:01.064786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bdab19f-4de2-41ee-a420-dd3db04005cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:01.065216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bdab19f-4de2-41ee-a420-dd3db04005cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:01.124818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5bdab19f-4de2-41ee-a420-dd3db04005cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:01.132621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5bdab19f-4de2-41ee-a420-dd3db04005cc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079141 Jul 28 03:53:01.133182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 889/1293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:01 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:01.670441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e277f40f-70ec-4c0d-941d-81816f34664c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:01.671076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e277f40f-70ec-4c0d-941d-81816f34664c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:01.677474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e277f40f-70ec-4c0d-941d-81816f34664c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:01.677923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e277f40f-70ec-4c0d-941d-81816f34664c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:01.678688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e277f40f-70ec-4c0d-941d-81816f34664c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:01.679114 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e277f40f-70ec-4c0d-941d-81816f34664c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:01.736793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e277f40f-70ec-4c0d-941d-81816f34664c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:01.744977 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e277f40f-70ec-4c0d-941d-81816f34664c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078075 Jul 28 03:53:01.745547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 890/1294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:01 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:02.149287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7a912452-be27-472f-a516-18094804ca53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:02.149927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7a912452-be27-472f-a516-18094804ca53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:02.155653 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a912452-be27-472f-a516-18094804ca53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:02.156139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a912452-be27-472f-a516-18094804ca53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:02.156896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a912452-be27-472f-a516-18094804ca53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:02.157320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a912452-be27-472f-a516-18094804ca53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:02.216692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7a912452-be27-472f-a516-18094804ca53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:02.226003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7a912452-be27-472f-a516-18094804ca53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.080683 Jul 28 03:53:02.226562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 891/1295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:02 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:02.761582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f1795d79-ed77-4527-b412-26521762aa7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:02.762193 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f1795d79-ed77-4527-b412-26521762aa7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:02.767963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1795d79-ed77-4527-b412-26521762aa7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:02.768412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1795d79-ed77-4527-b412-26521762aa7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:02.769172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1795d79-ed77-4527-b412-26521762aa7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:02.769612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f1795d79-ed77-4527-b412-26521762aa7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:02.835015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f1795d79-ed77-4527-b412-26521762aa7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:02.842575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f1795d79-ed77-4527-b412-26521762aa7e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.084625 Jul 28 03:53:02.843131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 892/1296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:02 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:03.242678 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-703c9134-3af9-4ecb-8480-e560f3e6da13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:03.243289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-703c9134-3af9-4ecb-8480-e560f3e6da13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:03.249069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-703c9134-3af9-4ecb-8480-e560f3e6da13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:03.249523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-703c9134-3af9-4ecb-8480-e560f3e6da13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:03.250291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-703c9134-3af9-4ecb-8480-e560f3e6da13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:03.250729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-703c9134-3af9-4ecb-8480-e560f3e6da13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:03.312383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-703c9134-3af9-4ecb-8480-e560f3e6da13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:03.320647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-703c9134-3af9-4ecb-8480-e560f3e6da13 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082181 Jul 28 03:53:03.321204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 893/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:03 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:03.859276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3f4be738-19d1-4e21-a672-bb7d528db170 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:03.859922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3f4be738-19d1-4e21-a672-bb7d528db170 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:03.866328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3f4be738-19d1-4e21-a672-bb7d528db170 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:03.866785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3f4be738-19d1-4e21-a672-bb7d528db170 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:03.867550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3f4be738-19d1-4e21-a672-bb7d528db170 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:03.868007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3f4be738-19d1-4e21-a672-bb7d528db170 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:03.927315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3f4be738-19d1-4e21-a672-bb7d528db170 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:03.934835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3f4be738-19d1-4e21-a672-bb7d528db170 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079220 Jul 28 03:53:03.935392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 894/1298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:03 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:04.337091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1e887f32-e65a-495e-a052-df7a9325d482 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:04.337742 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1e887f32-e65a-495e-a052-df7a9325d482 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:04.343556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e887f32-e65a-495e-a052-df7a9325d482 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:04.344035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e887f32-e65a-495e-a052-df7a9325d482 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:04.344805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e887f32-e65a-495e-a052-df7a9325d482 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:04.345238 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e887f32-e65a-495e-a052-df7a9325d482 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:04.404503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1e887f32-e65a-495e-a052-df7a9325d482 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:04.412818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1e887f32-e65a-495e-a052-df7a9325d482 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079395 Jul 28 03:53:04.413376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 895/1299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:04 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:04.951351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b0add6d7-e577-4aa5-be85-fe80fa711cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:04.951992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b0add6d7-e577-4aa5-be85-fe80fa711cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:04.958329 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0add6d7-e577-4aa5-be85-fe80fa711cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:04.958833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0add6d7-e577-4aa5-be85-fe80fa711cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:04.959595 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0add6d7-e577-4aa5-be85-fe80fa711cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:04.960058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b0add6d7-e577-4aa5-be85-fe80fa711cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:05.017416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b0add6d7-e577-4aa5-be85-fe80fa711cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:05.025671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b0add6d7-e577-4aa5-be85-fe80fa711cfc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077970 Jul 28 03:53:05.026227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 896/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:04 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:05.430198 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f64ea93d-7d8a-4300-b38f-dedc9471fda1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:05.430805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f64ea93d-7d8a-4300-b38f-dedc9471fda1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:05.436829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f64ea93d-7d8a-4300-b38f-dedc9471fda1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:05.437315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f64ea93d-7d8a-4300-b38f-dedc9471fda1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:05.438103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f64ea93d-7d8a-4300-b38f-dedc9471fda1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:05.438548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f64ea93d-7d8a-4300-b38f-dedc9471fda1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:05.497783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f64ea93d-7d8a-4300-b38f-dedc9471fda1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:05.506388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f64ea93d-7d8a-4300-b38f-dedc9471fda1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.080563 Jul 28 03:53:05.506952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 897/1301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:05 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:06.042619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ab69bd5a-e583-41e4-8ae8-ec3a67f592ae tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:06.043298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ab69bd5a-e583-41e4-8ae8-ec3a67f592ae tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:06.049184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab69bd5a-e583-41e4-8ae8-ec3a67f592ae tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:06.049631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab69bd5a-e583-41e4-8ae8-ec3a67f592ae tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:06.050390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab69bd5a-e583-41e4-8ae8-ec3a67f592ae tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:06.050819 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab69bd5a-e583-41e4-8ae8-ec3a67f592ae tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:06.109334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ab69bd5a-e583-41e4-8ae8-ec3a67f592ae tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:06.116997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ab69bd5a-e583-41e4-8ae8-ec3a67f592ae tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077962 Jul 28 03:53:06.117560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 898/1302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:06 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:06.523756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eb9841dd-9b39-463c-b73c-cfc2e43cf48d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:06.524386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eb9841dd-9b39-463c-b73c-cfc2e43cf48d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:06.530106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb9841dd-9b39-463c-b73c-cfc2e43cf48d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:06.530545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb9841dd-9b39-463c-b73c-cfc2e43cf48d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:06.531299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb9841dd-9b39-463c-b73c-cfc2e43cf48d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:06.531753 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb9841dd-9b39-463c-b73c-cfc2e43cf48d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:06.593056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eb9841dd-9b39-463c-b73c-cfc2e43cf48d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:06.600903 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eb9841dd-9b39-463c-b73c-cfc2e43cf48d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081463 Jul 28 03:53:06.601460 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 899/1303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:06 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:07.133564 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-283ea190-db23-4ee1-94a6-142d9f641894 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:07.134220 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-283ea190-db23-4ee1-94a6-142d9f641894 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:07.140053 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-283ea190-db23-4ee1-94a6-142d9f641894 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:07.140501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-283ea190-db23-4ee1-94a6-142d9f641894 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:07.141269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-283ea190-db23-4ee1-94a6-142d9f641894 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:07.141737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-283ea190-db23-4ee1-94a6-142d9f641894 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:07.202462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-283ea190-db23-4ee1-94a6-142d9f641894 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:07.210072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-283ea190-db23-4ee1-94a6-142d9f641894 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080292 Jul 28 03:53:07.210628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 900/1304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:07 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:07.617639 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f42cd2e1-2ffa-4a77-89e3-9074e09e815b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:07.618267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f42cd2e1-2ffa-4a77-89e3-9074e09e815b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:07.623967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f42cd2e1-2ffa-4a77-89e3-9074e09e815b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:07.624417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f42cd2e1-2ffa-4a77-89e3-9074e09e815b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:07.625178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f42cd2e1-2ffa-4a77-89e3-9074e09e815b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:07.625612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f42cd2e1-2ffa-4a77-89e3-9074e09e815b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:07.830544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f42cd2e1-2ffa-4a77-89e3-9074e09e815b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:07.838441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f42cd2e1-2ffa-4a77-89e3-9074e09e815b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.224926 Jul 28 03:53:07.838987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 901/1305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:07 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:08.227325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c3d7c420-7bb1-4ac1-8db9-d9a2327a6012 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:08.227952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c3d7c420-7bb1-4ac1-8db9-d9a2327a6012 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:08.233729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3d7c420-7bb1-4ac1-8db9-d9a2327a6012 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:08.234174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3d7c420-7bb1-4ac1-8db9-d9a2327a6012 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:08.234968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3d7c420-7bb1-4ac1-8db9-d9a2327a6012 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:08.235399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c3d7c420-7bb1-4ac1-8db9-d9a2327a6012 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:08.297986 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c3d7c420-7bb1-4ac1-8db9-d9a2327a6012 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:08.305624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c3d7c420-7bb1-4ac1-8db9-d9a2327a6012 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.082848 Jul 28 03:53:08.306168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 902/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:08 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:08.855135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5da57255-6eab-4bb3-9f7c-4bb2d38fe561 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:08.855879 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5da57255-6eab-4bb3-9f7c-4bb2d38fe561 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:08.861578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5da57255-6eab-4bb3-9f7c-4bb2d38fe561 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:08.862033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5da57255-6eab-4bb3-9f7c-4bb2d38fe561 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:08.862800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5da57255-6eab-4bb3-9f7c-4bb2d38fe561 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:08.863235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5da57255-6eab-4bb3-9f7c-4bb2d38fe561 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:08.922738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5da57255-6eab-4bb3-9f7c-4bb2d38fe561 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:08.930388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5da57255-6eab-4bb3-9f7c-4bb2d38fe561 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078896 Jul 28 03:53:08.930966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 903/1307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:08 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:09.322186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f469ac3b-becd-4e36-a4d1-80723e31dd6b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:09.322792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f469ac3b-becd-4e36-a4d1-80723e31dd6b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:09.328714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f469ac3b-becd-4e36-a4d1-80723e31dd6b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:09.329852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f469ac3b-becd-4e36-a4d1-80723e31dd6b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:09.329988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f469ac3b-becd-4e36-a4d1-80723e31dd6b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:09.330347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f469ac3b-becd-4e36-a4d1-80723e31dd6b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:09.392263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f469ac3b-becd-4e36-a4d1-80723e31dd6b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:09.400401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f469ac3b-becd-4e36-a4d1-80723e31dd6b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.081872 Jul 28 03:53:09.400974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 904/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:09 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:09.947431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3031b84c-cb4a-462c-b3c5-1d3ea961fb53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:09.948219 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3031b84c-cb4a-462c-b3c5-1d3ea961fb53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:09.953838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3031b84c-cb4a-462c-b3c5-1d3ea961fb53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:09.954280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3031b84c-cb4a-462c-b3c5-1d3ea961fb53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:09.955036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3031b84c-cb4a-462c-b3c5-1d3ea961fb53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:09.955469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3031b84c-cb4a-462c-b3c5-1d3ea961fb53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:10.018992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3031b84c-cb4a-462c-b3c5-1d3ea961fb53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:10.027319 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3031b84c-cb4a-462c-b3c5-1d3ea961fb53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.083660 Jul 28 03:53:10.028123 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 905/1309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:09 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:10.419170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f3596821-d6f7-49f2-abd6-2dceff56182f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:10.419813 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f3596821-d6f7-49f2-abd6-2dceff56182f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:10.425971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f3596821-d6f7-49f2-abd6-2dceff56182f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:10.426436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f3596821-d6f7-49f2-abd6-2dceff56182f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:10.427297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f3596821-d6f7-49f2-abd6-2dceff56182f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:10.427755 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f3596821-d6f7-49f2-abd6-2dceff56182f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:10.490273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f3596821-d6f7-49f2-abd6-2dceff56182f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:10.498217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f3596821-d6f7-49f2-abd6-2dceff56182f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.083147 Jul 28 03:53:10.498770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 906/1310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:10 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:11.044650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e54ddf6d-5bfe-41e7-99c3-d2c2c18a989f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:11.045325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e54ddf6d-5bfe-41e7-99c3-d2c2c18a989f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:11.051223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e54ddf6d-5bfe-41e7-99c3-d2c2c18a989f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:11.051719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e54ddf6d-5bfe-41e7-99c3-d2c2c18a989f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:11.052523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e54ddf6d-5bfe-41e7-99c3-d2c2c18a989f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:11.052991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e54ddf6d-5bfe-41e7-99c3-d2c2c18a989f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:11.115167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e54ddf6d-5bfe-41e7-99c3-d2c2c18a989f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:11.123291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e54ddf6d-5bfe-41e7-99c3-d2c2c18a989f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082377 Jul 28 03:53:11.123933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 907/1311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:11 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:11.515887 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b9d3e561-3d2a-4ea2-b0cc-6a12933a5212 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:11.516492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b9d3e561-3d2a-4ea2-b0cc-6a12933a5212 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:11.522529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b9d3e561-3d2a-4ea2-b0cc-6a12933a5212 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:11.522970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b9d3e561-3d2a-4ea2-b0cc-6a12933a5212 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:11.523738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b9d3e561-3d2a-4ea2-b0cc-6a12933a5212 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:11.524172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b9d3e561-3d2a-4ea2-b0cc-6a12933a5212 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:11.582528 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b9d3e561-3d2a-4ea2-b0cc-6a12933a5212 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:11.590102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b9d3e561-3d2a-4ea2-b0cc-6a12933a5212 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077806 Jul 28 03:53:11.590683 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 908/1312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:11 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:12.141265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-786e5fcb-5684-4f52-a509-6b3d374e4540 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:12.141881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-786e5fcb-5684-4f52-a509-6b3d374e4540 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:12.148229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-786e5fcb-5684-4f52-a509-6b3d374e4540 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:12.148681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-786e5fcb-5684-4f52-a509-6b3d374e4540 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:12.149458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-786e5fcb-5684-4f52-a509-6b3d374e4540 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:12.149892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-786e5fcb-5684-4f52-a509-6b3d374e4540 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:12.210696 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-786e5fcb-5684-4f52-a509-6b3d374e4540 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:12.218425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-786e5fcb-5684-4f52-a509-6b3d374e4540 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.080854 Jul 28 03:53:12.218979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 909/1313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:12 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:12.607073 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fcea0e39-4433-426f-8da9-7c3362d332d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:12.607687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fcea0e39-4433-426f-8da9-7c3362d332d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:12.613507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fcea0e39-4433-426f-8da9-7c3362d332d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:12.613999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fcea0e39-4433-426f-8da9-7c3362d332d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:12.614764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fcea0e39-4433-426f-8da9-7c3362d332d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:12.615207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fcea0e39-4433-426f-8da9-7c3362d332d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:12.673526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fcea0e39-4433-426f-8da9-7c3362d332d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:12.681139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fcea0e39-4433-426f-8da9-7c3362d332d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077769 Jul 28 03:53:12.681698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 910/1314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:12 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:13.234966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2e762927-9a7c-4c8e-870a-14461396d6d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:13.235575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2e762927-9a7c-4c8e-870a-14461396d6d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:13.242186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e762927-9a7c-4c8e-870a-14461396d6d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:13.242635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e762927-9a7c-4c8e-870a-14461396d6d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:13.243402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e762927-9a7c-4c8e-870a-14461396d6d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:13.243869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e762927-9a7c-4c8e-870a-14461396d6d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:13.306286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2e762927-9a7c-4c8e-870a-14461396d6d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:13.314125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2e762927-9a7c-4c8e-870a-14461396d6d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082805 Jul 28 03:53:13.314672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 911/1315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:13 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:13.697602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-72bfcb02-bb7d-4ab2-a0c9-5a0bd7e6288e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:13.698239 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-72bfcb02-bb7d-4ab2-a0c9-5a0bd7e6288e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:13.703986 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72bfcb02-bb7d-4ab2-a0c9-5a0bd7e6288e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:13.704426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72bfcb02-bb7d-4ab2-a0c9-5a0bd7e6288e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:13.705179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72bfcb02-bb7d-4ab2-a0c9-5a0bd7e6288e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:13.705604 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72bfcb02-bb7d-4ab2-a0c9-5a0bd7e6288e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:13.765249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-72bfcb02-bb7d-4ab2-a0c9-5a0bd7e6288e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:13.773516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-72bfcb02-bb7d-4ab2-a0c9-5a0bd7e6288e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079565 Jul 28 03:53:13.774062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 912/1316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:13 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:14.330974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-056e6d83-5f52-493c-b845-cb956b4980de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:14.331569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-056e6d83-5f52-493c-b845-cb956b4980de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:14.337428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-056e6d83-5f52-493c-b845-cb956b4980de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:14.337869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-056e6d83-5f52-493c-b845-cb956b4980de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:14.338624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-056e6d83-5f52-493c-b845-cb956b4980de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:14.339054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-056e6d83-5f52-493c-b845-cb956b4980de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:14.398083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-056e6d83-5f52-493c-b845-cb956b4980de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:14.405781 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-056e6d83-5f52-493c-b845-cb956b4980de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078782 Jul 28 03:53:14.406332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 913/1317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:14 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:14.790757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0a34617b-93c1-4cf6-8faf-87d13ffa0215 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:14.791363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0a34617b-93c1-4cf6-8faf-87d13ffa0215 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:14.797084 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a34617b-93c1-4cf6-8faf-87d13ffa0215 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:14.797527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a34617b-93c1-4cf6-8faf-87d13ffa0215 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:14.798312 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a34617b-93c1-4cf6-8faf-87d13ffa0215 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:14.798738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0a34617b-93c1-4cf6-8faf-87d13ffa0215 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:14.857719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0a34617b-93c1-4cf6-8faf-87d13ffa0215 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:14.865870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0a34617b-93c1-4cf6-8faf-87d13ffa0215 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078722 Jul 28 03:53:14.866419 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 914/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:14 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:15.422278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-721c746a-f649-415b-9839-25a9b9dedf91 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:15.422901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-721c746a-f649-415b-9839-25a9b9dedf91 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:15.429259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-721c746a-f649-415b-9839-25a9b9dedf91 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:15.429709 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-721c746a-f649-415b-9839-25a9b9dedf91 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:15.430475 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-721c746a-f649-415b-9839-25a9b9dedf91 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:15.430910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-721c746a-f649-415b-9839-25a9b9dedf91 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:15.489767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-721c746a-f649-415b-9839-25a9b9dedf91 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:15.497591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-721c746a-f649-415b-9839-25a9b9dedf91 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079084 Jul 28 03:53:15.498145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 915/1319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:15 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:15.882050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d7c4c599-523e-45d0-afee-a42265a0d7f7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:15.882661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d7c4c599-523e-45d0-afee-a42265a0d7f7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:15.888481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d7c4c599-523e-45d0-afee-a42265a0d7f7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:15.888929 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d7c4c599-523e-45d0-afee-a42265a0d7f7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:15.889691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d7c4c599-523e-45d0-afee-a42265a0d7f7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:15.890124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d7c4c599-523e-45d0-afee-a42265a0d7f7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:15.947749 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d7c4c599-523e-45d0-afee-a42265a0d7f7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:15.955248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d7c4c599-523e-45d0-afee-a42265a0d7f7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.076827 Jul 28 03:53:15.955822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 916/1320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:15 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:16.513454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-83d10056-c008-45d6-b15a-36484517fa7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:16.514069 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-83d10056-c008-45d6-b15a-36484517fa7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:16.519873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83d10056-c008-45d6-b15a-36484517fa7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:16.520780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83d10056-c008-45d6-b15a-36484517fa7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:16.521547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83d10056-c008-45d6-b15a-36484517fa7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:16.521982 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-83d10056-c008-45d6-b15a-36484517fa7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:16.583528 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-83d10056-c008-45d6-b15a-36484517fa7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:16.591130 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-83d10056-c008-45d6-b15a-36484517fa7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081321 Jul 28 03:53:16.591680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 917/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:16 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:16.972525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2509c095-1738-40a1-b787-8cff6d98e076 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:16.973754 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2509c095-1738-40a1-b787-8cff6d98e076 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:16.979735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2509c095-1738-40a1-b787-8cff6d98e076 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:16.980201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2509c095-1738-40a1-b787-8cff6d98e076 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:16.980966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2509c095-1738-40a1-b787-8cff6d98e076 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:16.981397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2509c095-1738-40a1-b787-8cff6d98e076 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:17.039447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2509c095-1738-40a1-b787-8cff6d98e076 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:17.047052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2509c095-1738-40a1-b787-8cff6d98e076 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078201 Jul 28 03:53:17.047621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 918/1322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:16 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:17.608419 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f2ad8aa1-937e-41fb-9150-a5a692509bc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:17.609058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f2ad8aa1-937e-41fb-9150-a5a692509bc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:17.614807 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f2ad8aa1-937e-41fb-9150-a5a692509bc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:17.615251 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f2ad8aa1-937e-41fb-9150-a5a692509bc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:17.616051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f2ad8aa1-937e-41fb-9150-a5a692509bc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:17.616489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f2ad8aa1-937e-41fb-9150-a5a692509bc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:17.675226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f2ad8aa1-937e-41fb-9150-a5a692509bc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:17.682822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f2ad8aa1-937e-41fb-9150-a5a692509bc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078169 Jul 28 03:53:17.683375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 919/1323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:17 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:18.066825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-46a24330-d1c4-429d-be9a-77fd5e32c5dc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:18.067440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-46a24330-d1c4-429d-be9a-77fd5e32c5dc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:18.074311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46a24330-d1c4-429d-be9a-77fd5e32c5dc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:18.075220 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46a24330-d1c4-429d-be9a-77fd5e32c5dc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:18.076050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46a24330-d1c4-429d-be9a-77fd5e32c5dc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:18.076484 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46a24330-d1c4-429d-be9a-77fd5e32c5dc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:18.136222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-46a24330-d1c4-429d-be9a-77fd5e32c5dc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:18.144024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-46a24330-d1c4-429d-be9a-77fd5e32c5dc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.083251 Jul 28 03:53:18.144577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 920/1324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:18 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:18.700172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-46bae980-b2e7-4947-a531-289849b7de81 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:18.700797 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-46bae980-b2e7-4947-a531-289849b7de81 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:18.706517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46bae980-b2e7-4947-a531-289849b7de81 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:18.706965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46bae980-b2e7-4947-a531-289849b7de81 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:18.707811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46bae980-b2e7-4947-a531-289849b7de81 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:18.708345 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46bae980-b2e7-4947-a531-289849b7de81 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:18.766949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-46bae980-b2e7-4947-a531-289849b7de81 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:18.775152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-46bae980-b2e7-4947-a531-289849b7de81 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078643 Jul 28 03:53:18.775721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 921/1325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:18 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:19.160100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f577ca6c-6d86-4841-b961-6b0959d22537 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:19.160939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f577ca6c-6d86-4841-b961-6b0959d22537 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:19.166854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f577ca6c-6d86-4841-b961-6b0959d22537 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:19.167298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f577ca6c-6d86-4841-b961-6b0959d22537 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:19.168095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f577ca6c-6d86-4841-b961-6b0959d22537 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:19.168529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f577ca6c-6d86-4841-b961-6b0959d22537 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:19.228486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f577ca6c-6d86-4841-b961-6b0959d22537 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:19.236056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f577ca6c-6d86-4841-b961-6b0959d22537 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079593 Jul 28 03:53:19.236619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 922/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:19 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:19.791691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-530938e9-da83-4faa-9e30-00695a55e0d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:19.792421 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-530938e9-da83-4faa-9e30-00695a55e0d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:19.798152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-530938e9-da83-4faa-9e30-00695a55e0d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:19.798599 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-530938e9-da83-4faa-9e30-00695a55e0d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:19.799362 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-530938e9-da83-4faa-9e30-00695a55e0d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:19.799834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-530938e9-da83-4faa-9e30-00695a55e0d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:19.862382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-530938e9-da83-4faa-9e30-00695a55e0d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:19.870663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-530938e9-da83-4faa-9e30-00695a55e0d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082640 Jul 28 03:53:19.871217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 923/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:19 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:20.253135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-123e9a5d-2d9f-4718-b7f6-5735195693d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:20.253751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-123e9a5d-2d9f-4718-b7f6-5735195693d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:20.260185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-123e9a5d-2d9f-4718-b7f6-5735195693d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:20.260635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-123e9a5d-2d9f-4718-b7f6-5735195693d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:20.261403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-123e9a5d-2d9f-4718-b7f6-5735195693d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:20.261837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-123e9a5d-2d9f-4718-b7f6-5735195693d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:20.320397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-123e9a5d-2d9f-4718-b7f6-5735195693d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.328251 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-123e9a5d-2d9f-4718-b7f6-5735195693d3 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078876 Jul 28 03:53:20.328799 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 924/1328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:20 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:20.887080 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d06bbede-dec5-4508-936f-66d47cac24d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:20.887832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d06bbede-dec5-4508-936f-66d47cac24d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:20.893636 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d06bbede-dec5-4508-936f-66d47cac24d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:20.894079 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d06bbede-dec5-4508-936f-66d47cac24d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:20.894883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d06bbede-dec5-4508-936f-66d47cac24d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:20.895448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d06bbede-dec5-4508-936f-66d47cac24d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:20.955062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d06bbede-dec5-4508-936f-66d47cac24d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.962747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d06bbede-dec5-4508-936f-66d47cac24d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079380 Jul 28 03:53:20.963297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 925/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:20 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:21.344919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-28a5844c-e2af-4911-b301-88481ffb952e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:21.345526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-28a5844c-e2af-4911-b301-88481ffb952e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:21.352326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28a5844c-e2af-4911-b301-88481ffb952e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:21.352774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28a5844c-e2af-4911-b301-88481ffb952e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:21.353536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28a5844c-e2af-4911-b301-88481ffb952e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:21.353967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28a5844c-e2af-4911-b301-88481ffb952e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:21.412197 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-28a5844c-e2af-4911-b301-88481ffb952e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:21.419763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-28a5844c-e2af-4911-b301-88481ffb952e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078512 Jul 28 03:53:21.420324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 926/1330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:21 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:21.979465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7e6fb2fb-9018-459d-b618-ce760e52741b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:21.980149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7e6fb2fb-9018-459d-b618-ce760e52741b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:21.985808 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e6fb2fb-9018-459d-b618-ce760e52741b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:21.986249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e6fb2fb-9018-459d-b618-ce760e52741b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:21.987008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e6fb2fb-9018-459d-b618-ce760e52741b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:21.987439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e6fb2fb-9018-459d-b618-ce760e52741b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:22.045746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7e6fb2fb-9018-459d-b618-ce760e52741b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:22.053832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7e6fb2fb-9018-459d-b618-ce760e52741b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078299 Jul 28 03:53:22.054463 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 927/1331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:21 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:22.436193 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ef0cb786-daa1-442b-aa32-4c7032f9dd8f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:22.436798 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ef0cb786-daa1-442b-aa32-4c7032f9dd8f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:22.442677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef0cb786-daa1-442b-aa32-4c7032f9dd8f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:22.443117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef0cb786-daa1-442b-aa32-4c7032f9dd8f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:22.443901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef0cb786-daa1-442b-aa32-4c7032f9dd8f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:22.444329 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef0cb786-daa1-442b-aa32-4c7032f9dd8f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:22.503029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ef0cb786-daa1-442b-aa32-4c7032f9dd8f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:22.510725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ef0cb786-daa1-442b-aa32-4c7032f9dd8f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078203 Jul 28 03:53:22.511275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 928/1332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:22 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:23.070211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ae739428-cc8f-4297-a8ce-b5adf777f02e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:23.070858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ae739428-cc8f-4297-a8ce-b5adf777f02e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:23.076585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae739428-cc8f-4297-a8ce-b5adf777f02e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:23.077036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae739428-cc8f-4297-a8ce-b5adf777f02e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:23.077803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae739428-cc8f-4297-a8ce-b5adf777f02e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:23.078239 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae739428-cc8f-4297-a8ce-b5adf777f02e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:23.140451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ae739428-cc8f-4297-a8ce-b5adf777f02e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:23.148364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ae739428-cc8f-4297-a8ce-b5adf777f02e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081886 Jul 28 03:53:23.148921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 929/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:23 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:23.527771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7dda4bb0-a56a-45ee-805f-8d825551a62a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:23.528299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7dda4bb0-a56a-45ee-805f-8d825551a62a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:23.534004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7dda4bb0-a56a-45ee-805f-8d825551a62a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:23.534444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7dda4bb0-a56a-45ee-805f-8d825551a62a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:23.535194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7dda4bb0-a56a-45ee-805f-8d825551a62a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:23.536448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7dda4bb0-a56a-45ee-805f-8d825551a62a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:23.595832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7dda4bb0-a56a-45ee-805f-8d825551a62a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:23.604714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7dda4bb0-a56a-45ee-805f-8d825551a62a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080674 Jul 28 03:53:23.605268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 930/1334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:23 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:24.165812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-68384471-e910-48c7-9a46-7a50a87b8bb7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:24.166441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-68384471-e910-48c7-9a46-7a50a87b8bb7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:24.172375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68384471-e910-48c7-9a46-7a50a87b8bb7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:24.172817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68384471-e910-48c7-9a46-7a50a87b8bb7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:24.173578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68384471-e910-48c7-9a46-7a50a87b8bb7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:24.174006 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68384471-e910-48c7-9a46-7a50a87b8bb7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:24.234076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-68384471-e910-48c7-9a46-7a50a87b8bb7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.241991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-68384471-e910-48c7-9a46-7a50a87b8bb7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079833 Jul 28 03:53:24.242540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 931/1335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:24 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:24.621348 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-caff6411-21e7-4a2f-a5ac-0cec3359fa74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:24.621984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-caff6411-21e7-4a2f-a5ac-0cec3359fa74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:24.627734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caff6411-21e7-4a2f-a5ac-0cec3359fa74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:24.628193 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caff6411-21e7-4a2f-a5ac-0cec3359fa74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:24.628958 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caff6411-21e7-4a2f-a5ac-0cec3359fa74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:24.629912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-caff6411-21e7-4a2f-a5ac-0cec3359fa74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:24.688324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-caff6411-21e7-4a2f-a5ac-0cec3359fa74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.696639 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-caff6411-21e7-4a2f-a5ac-0cec3359fa74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078996 Jul 28 03:53:24.697195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 932/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:24 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:25.258413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ef8c068d-30cd-45cd-a6c7-86fd930a949a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:25.259121 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ef8c068d-30cd-45cd-a6c7-86fd930a949a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:25.265186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef8c068d-30cd-45cd-a6c7-86fd930a949a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:25.265631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef8c068d-30cd-45cd-a6c7-86fd930a949a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:25.266393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef8c068d-30cd-45cd-a6c7-86fd930a949a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:25.266822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef8c068d-30cd-45cd-a6c7-86fd930a949a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:25.326252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ef8c068d-30cd-45cd-a6c7-86fd930a949a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:25.334061 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ef8c068d-30cd-45cd-a6c7-86fd930a949a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079422 Jul 28 03:53:25.334611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 933/1337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:25 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:25.712902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-67fb421d-5538-4bce-81bc-39b1ec3894d5 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:25.713451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-67fb421d-5538-4bce-81bc-39b1ec3894d5 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:25.719264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-67fb421d-5538-4bce-81bc-39b1ec3894d5 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:25.719729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-67fb421d-5538-4bce-81bc-39b1ec3894d5 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:25.720512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-67fb421d-5538-4bce-81bc-39b1ec3894d5 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:25.720956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-67fb421d-5538-4bce-81bc-39b1ec3894d5 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:25.780085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-67fb421d-5538-4bce-81bc-39b1ec3894d5 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:25.788800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-67fb421d-5538-4bce-81bc-39b1ec3894d5 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079522 Jul 28 03:53:25.789392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 934/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:25 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:26.350841 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-222e7f70-dbdd-4cb4-b6eb-c96b5a435e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:26.351470 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-222e7f70-dbdd-4cb4-b6eb-c96b5a435e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:26.357143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222e7f70-dbdd-4cb4-b6eb-c96b5a435e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:26.357583 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222e7f70-dbdd-4cb4-b6eb-c96b5a435e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:26.358339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222e7f70-dbdd-4cb4-b6eb-c96b5a435e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:26.358764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-222e7f70-dbdd-4cb4-b6eb-c96b5a435e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:26.421120 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-222e7f70-dbdd-4cb4-b6eb-c96b5a435e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:26.429908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-222e7f70-dbdd-4cb4-b6eb-c96b5a435e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.083405 Jul 28 03:53:26.430464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 935/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:26 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:26.805679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-df6fd5bc-f27c-4b6b-9ea7-4a66015b8c88 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:26.806213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-df6fd5bc-f27c-4b6b-9ea7-4a66015b8c88 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:26.811942 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df6fd5bc-f27c-4b6b-9ea7-4a66015b8c88 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:26.812388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df6fd5bc-f27c-4b6b-9ea7-4a66015b8c88 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:26.813142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df6fd5bc-f27c-4b6b-9ea7-4a66015b8c88 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:26.813569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df6fd5bc-f27c-4b6b-9ea7-4a66015b8c88 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:26.872304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-df6fd5bc-f27c-4b6b-9ea7-4a66015b8c88 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:26.880474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-df6fd5bc-f27c-4b6b-9ea7-4a66015b8c88 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079219 Jul 28 03:53:26.881034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 936/1340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:26 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:27.446744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-08036cad-2030-4c83-8ed6-bfbb637d2b26 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:27.447356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-08036cad-2030-4c83-8ed6-bfbb637d2b26 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:27.453141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08036cad-2030-4c83-8ed6-bfbb637d2b26 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:27.453585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08036cad-2030-4c83-8ed6-bfbb637d2b26 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:27.454350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08036cad-2030-4c83-8ed6-bfbb637d2b26 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:27.454783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08036cad-2030-4c83-8ed6-bfbb637d2b26 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:27.513337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-08036cad-2030-4c83-8ed6-bfbb637d2b26 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:27.521146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-08036cad-2030-4c83-8ed6-bfbb637d2b26 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078108 Jul 28 03:53:27.521701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 937/1341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:27 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:27.897443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c2e9d248-8d21-4b9f-b4b1-f1a9aa76438a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:27.898049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c2e9d248-8d21-4b9f-b4b1-f1a9aa76438a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:27.903750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2e9d248-8d21-4b9f-b4b1-f1a9aa76438a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:27.904216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2e9d248-8d21-4b9f-b4b1-f1a9aa76438a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:27.904970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2e9d248-8d21-4b9f-b4b1-f1a9aa76438a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:27.905404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2e9d248-8d21-4b9f-b4b1-f1a9aa76438a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:27.964243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c2e9d248-8d21-4b9f-b4b1-f1a9aa76438a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:27.971769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c2e9d248-8d21-4b9f-b4b1-f1a9aa76438a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078578 Jul 28 03:53:27.972320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 938/1342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:27 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:28.537469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f8096626-87d2-45d5-a934-85c24a27ba6d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:28.538103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f8096626-87d2-45d5-a934-85c24a27ba6d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:28.543927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8096626-87d2-45d5-a934-85c24a27ba6d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:28.544376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8096626-87d2-45d5-a934-85c24a27ba6d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:28.545140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8096626-87d2-45d5-a934-85c24a27ba6d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:28.545575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8096626-87d2-45d5-a934-85c24a27ba6d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:28.603969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f8096626-87d2-45d5-a934-85c24a27ba6d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:28.611555 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f8096626-87d2-45d5-a934-85c24a27ba6d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.077955 Jul 28 03:53:28.612144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 939/1343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:28 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:28.990315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-61a8336d-3e79-4937-8f9d-499febd4c01c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:28.990923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-61a8336d-3e79-4937-8f9d-499febd4c01c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:28.996691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-61a8336d-3e79-4937-8f9d-499febd4c01c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:28.997147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-61a8336d-3e79-4937-8f9d-499febd4c01c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:28.997920 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-61a8336d-3e79-4937-8f9d-499febd4c01c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:28.998357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-61a8336d-3e79-4937-8f9d-499febd4c01c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:29.057232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-61a8336d-3e79-4937-8f9d-499febd4c01c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:29.064812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-61a8336d-3e79-4937-8f9d-499febd4c01c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078781 Jul 28 03:53:29.065378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 940/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:28 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:29.628619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e0027747-3a90-4fcb-a130-329d6720037b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:29.630214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e0027747-3a90-4fcb-a130-329d6720037b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:29.635546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0027747-3a90-4fcb-a130-329d6720037b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:29.636027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0027747-3a90-4fcb-a130-329d6720037b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:29.636801 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0027747-3a90-4fcb-a130-329d6720037b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:29.637238 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0027747-3a90-4fcb-a130-329d6720037b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:29.698841 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e0027747-3a90-4fcb-a130-329d6720037b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:29.706519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e0027747-3a90-4fcb-a130-329d6720037b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081546 Jul 28 03:53:29.707109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 941/1345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:29 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:30.080820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-445365cd-96e1-4d9a-b14f-d002c9168328 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:30.081431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-445365cd-96e1-4d9a-b14f-d002c9168328 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:30.087513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-445365cd-96e1-4d9a-b14f-d002c9168328 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:30.088004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-445365cd-96e1-4d9a-b14f-d002c9168328 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:30.088761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-445365cd-96e1-4d9a-b14f-d002c9168328 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:30.089189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-445365cd-96e1-4d9a-b14f-d002c9168328 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:30.149551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-445365cd-96e1-4d9a-b14f-d002c9168328 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:30.157334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-445365cd-96e1-4d9a-b14f-d002c9168328 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080157 Jul 28 03:53:30.157884 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 942/1346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:30 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:30.723908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-458e8c63-3b71-4255-8b4d-e7d7dfb41f49 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:30.724567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-458e8c63-3b71-4255-8b4d-e7d7dfb41f49 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:30.730617 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-458e8c63-3b71-4255-8b4d-e7d7dfb41f49 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:30.731068 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-458e8c63-3b71-4255-8b4d-e7d7dfb41f49 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:30.731870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-458e8c63-3b71-4255-8b4d-e7d7dfb41f49 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:30.732307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-458e8c63-3b71-4255-8b4d-e7d7dfb41f49 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:30.791697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-458e8c63-3b71-4255-8b4d-e7d7dfb41f49 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:30.799444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-458e8c63-3b71-4255-8b4d-e7d7dfb41f49 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079835 Jul 28 03:53:30.800038 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 943/1347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:30 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:31.173854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c6f5616e-a3eb-4e56-bda4-6720ebc16da4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:31.174467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c6f5616e-a3eb-4e56-bda4-6720ebc16da4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:31.180326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6f5616e-a3eb-4e56-bda4-6720ebc16da4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:31.180782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6f5616e-a3eb-4e56-bda4-6720ebc16da4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:31.181544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6f5616e-a3eb-4e56-bda4-6720ebc16da4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:31.181976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6f5616e-a3eb-4e56-bda4-6720ebc16da4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:31.240722 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c6f5616e-a3eb-4e56-bda4-6720ebc16da4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:31.248179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c6f5616e-a3eb-4e56-bda4-6720ebc16da4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078018 Jul 28 03:53:31.248738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 944/1348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:31 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:31.816197 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-947ef232-cc5d-484a-a7cb-275165f8ac18 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:31.817575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-947ef232-cc5d-484a-a7cb-275165f8ac18 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:31.823243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-947ef232-cc5d-484a-a7cb-275165f8ac18 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:31.823686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-947ef232-cc5d-484a-a7cb-275165f8ac18 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:31.824477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-947ef232-cc5d-484a-a7cb-275165f8ac18 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:31.824901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-947ef232-cc5d-484a-a7cb-275165f8ac18 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:31.883453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-947ef232-cc5d-484a-a7cb-275165f8ac18 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:31.891054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-947ef232-cc5d-484a-a7cb-275165f8ac18 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078398 Jul 28 03:53:31.891601 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 945/1349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:31 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:32.265594 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-69c55911-ee2c-409b-950f-87e06bea660c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:32.266242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-69c55911-ee2c-409b-950f-87e06bea660c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:32.272875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-69c55911-ee2c-409b-950f-87e06bea660c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:32.273352 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-69c55911-ee2c-409b-950f-87e06bea660c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:32.274190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-69c55911-ee2c-409b-950f-87e06bea660c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:32.274649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-69c55911-ee2c-409b-950f-87e06bea660c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:32.333991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-69c55911-ee2c-409b-950f-87e06bea660c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.341857 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-69c55911-ee2c-409b-950f-87e06bea660c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080251 Jul 28 03:53:32.342411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 946/1350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:32 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:32.908012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-751bd99d-8b6c-47ff-b063-de85a3ced114 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:32.908647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-751bd99d-8b6c-47ff-b063-de85a3ced114 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:32.914486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-751bd99d-8b6c-47ff-b063-de85a3ced114 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:32.914931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-751bd99d-8b6c-47ff-b063-de85a3ced114 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:32.915700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-751bd99d-8b6c-47ff-b063-de85a3ced114 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:32.916163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-751bd99d-8b6c-47ff-b063-de85a3ced114 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:32.978467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-751bd99d-8b6c-47ff-b063-de85a3ced114 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.986189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-751bd99d-8b6c-47ff-b063-de85a3ced114 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082062 Jul 28 03:53:32.986740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 947/1351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:32 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:33.358978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cbc3dda8-993f-4f55-a5c1-e597e068408d tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:33.359621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cbc3dda8-993f-4f55-a5c1-e597e068408d tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:33.366213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbc3dda8-993f-4f55-a5c1-e597e068408d tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:33.366655 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbc3dda8-993f-4f55-a5c1-e597e068408d tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:33.367408 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbc3dda8-993f-4f55-a5c1-e597e068408d tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:33.367863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cbc3dda8-993f-4f55-a5c1-e597e068408d tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:33.425196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cbc3dda8-993f-4f55-a5c1-e597e068408d tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:33.433316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cbc3dda8-993f-4f55-a5c1-e597e068408d tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077946 Jul 28 03:53:33.433866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 948/1352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:33 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:34.003167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-06474d34-4e90-433c-ac36-e61fa957afd2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:34.003838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-06474d34-4e90-433c-ac36-e61fa957afd2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:34.009831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06474d34-4e90-433c-ac36-e61fa957afd2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:34.010280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06474d34-4e90-433c-ac36-e61fa957afd2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:34.011046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06474d34-4e90-433c-ac36-e61fa957afd2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:34.011480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06474d34-4e90-433c-ac36-e61fa957afd2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:34.069689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-06474d34-4e90-433c-ac36-e61fa957afd2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:34.077377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-06474d34-4e90-433c-ac36-e61fa957afd2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.077867 Jul 28 03:53:34.077931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 949/1353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:33 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:34.449227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2664dd0b-673d-4616-a83c-2fca0bbd33f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:34.449839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2664dd0b-673d-4616-a83c-2fca0bbd33f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:34.455650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2664dd0b-673d-4616-a83c-2fca0bbd33f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:34.456127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2664dd0b-673d-4616-a83c-2fca0bbd33f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:34.456891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2664dd0b-673d-4616-a83c-2fca0bbd33f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:34.458028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2664dd0b-673d-4616-a83c-2fca0bbd33f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:34.517562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2664dd0b-673d-4616-a83c-2fca0bbd33f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:34.525221 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2664dd0b-673d-4616-a83c-2fca0bbd33f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079615 Jul 28 03:53:34.525773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 950/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:34 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:35.094177 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5df196ae-80c4-42f4-8d97-0cc92a80e4de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:35.094877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5df196ae-80c4-42f4-8d97-0cc92a80e4de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:35.101454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5df196ae-80c4-42f4-8d97-0cc92a80e4de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:35.101905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5df196ae-80c4-42f4-8d97-0cc92a80e4de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:35.102682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5df196ae-80c4-42f4-8d97-0cc92a80e4de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:35.103122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5df196ae-80c4-42f4-8d97-0cc92a80e4de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:35.162269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5df196ae-80c4-42f4-8d97-0cc92a80e4de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:35.170952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5df196ae-80c4-42f4-8d97-0cc92a80e4de tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.080237 Jul 28 03:53:35.171552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 951/1355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:35 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:35.542237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e5407578-4b4c-4f6d-ba27-be399ed45785 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:35.542782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e5407578-4b4c-4f6d-ba27-be399ed45785 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:35.548643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e5407578-4b4c-4f6d-ba27-be399ed45785 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:35.549095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e5407578-4b4c-4f6d-ba27-be399ed45785 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:35.549860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e5407578-4b4c-4f6d-ba27-be399ed45785 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:35.550303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e5407578-4b4c-4f6d-ba27-be399ed45785 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:35.608361 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e5407578-4b4c-4f6d-ba27-be399ed45785 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:35.616072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e5407578-4b4c-4f6d-ba27-be399ed45785 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077543 Jul 28 03:53:35.616634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 952/1356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:35 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:36.189585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c95207f1-aa65-44cb-848a-f1b8582feacc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:36.190223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c95207f1-aa65-44cb-848a-f1b8582feacc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:36.196746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c95207f1-aa65-44cb-848a-f1b8582feacc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:36.197192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c95207f1-aa65-44cb-848a-f1b8582feacc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:36.197947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c95207f1-aa65-44cb-848a-f1b8582feacc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:36.198411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c95207f1-aa65-44cb-848a-f1b8582feacc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:36.261005 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c95207f1-aa65-44cb-848a-f1b8582feacc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:36.268621 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c95207f1-aa65-44cb-848a-f1b8582feacc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.083102 Jul 28 03:53:36.269164 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 953/1357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:36 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:36.632815 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-29e7ce3e-d2f6-46c8-b13b-67a2fdaeb592 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:36.633422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-29e7ce3e-d2f6-46c8-b13b-67a2fdaeb592 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:36.639125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e7ce3e-d2f6-46c8-b13b-67a2fdaeb592 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:36.639563 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e7ce3e-d2f6-46c8-b13b-67a2fdaeb592 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:36.640346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e7ce3e-d2f6-46c8-b13b-67a2fdaeb592 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:36.640776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e7ce3e-d2f6-46c8-b13b-67a2fdaeb592 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:36.699606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-29e7ce3e-d2f6-46c8-b13b-67a2fdaeb592 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:36.707575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-29e7ce3e-d2f6-46c8-b13b-67a2fdaeb592 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078394 Jul 28 03:53:36.708151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 954/1358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:36 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:37.285432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5bf4d7ae-abc6-46e5-9c31-8d23a239aec1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:37.286159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5bf4d7ae-abc6-46e5-9c31-8d23a239aec1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:37.291928 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bf4d7ae-abc6-46e5-9c31-8d23a239aec1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:37.292368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bf4d7ae-abc6-46e5-9c31-8d23a239aec1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:37.293122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bf4d7ae-abc6-46e5-9c31-8d23a239aec1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:37.293549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5bf4d7ae-abc6-46e5-9c31-8d23a239aec1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:37.352209 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5bf4d7ae-abc6-46e5-9c31-8d23a239aec1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:37.359888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5bf4d7ae-abc6-46e5-9c31-8d23a239aec1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078308 Jul 28 03:53:37.360443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 955/1359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:37 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:37.724301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-06380545-cba2-40f2-90cc-7283cedfb93c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:37.724923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-06380545-cba2-40f2-90cc-7283cedfb93c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:37.730932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06380545-cba2-40f2-90cc-7283cedfb93c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:37.731380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06380545-cba2-40f2-90cc-7283cedfb93c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:37.732169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06380545-cba2-40f2-90cc-7283cedfb93c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:37.732603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06380545-cba2-40f2-90cc-7283cedfb93c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:37.791670 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-06380545-cba2-40f2-90cc-7283cedfb93c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:37.799388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-06380545-cba2-40f2-90cc-7283cedfb93c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078864 Jul 28 03:53:37.799976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 956/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:37 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:38.377071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0249564b-4a1b-48c6-828c-6bc9fcd2f9a7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:38.377777 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0249564b-4a1b-48c6-828c-6bc9fcd2f9a7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:38.383431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0249564b-4a1b-48c6-828c-6bc9fcd2f9a7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:38.383923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0249564b-4a1b-48c6-828c-6bc9fcd2f9a7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:38.384693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0249564b-4a1b-48c6-828c-6bc9fcd2f9a7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:38.385130 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0249564b-4a1b-48c6-828c-6bc9fcd2f9a7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:38.444008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0249564b-4a1b-48c6-828c-6bc9fcd2f9a7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:38.451590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0249564b-4a1b-48c6-828c-6bc9fcd2f9a7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078245 Jul 28 03:53:38.452176 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 957/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:38 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:38.817253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5866ed4e-6a34-4b8b-b46a-117e1ed7bf9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:38.817887 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5866ed4e-6a34-4b8b-b46a-117e1ed7bf9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:38.823887 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5866ed4e-6a34-4b8b-b46a-117e1ed7bf9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:38.824370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5866ed4e-6a34-4b8b-b46a-117e1ed7bf9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:38.825167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5866ed4e-6a34-4b8b-b46a-117e1ed7bf9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:38.825630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5866ed4e-6a34-4b8b-b46a-117e1ed7bf9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:38.885757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5866ed4e-6a34-4b8b-b46a-117e1ed7bf9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:38.893406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5866ed4e-6a34-4b8b-b46a-117e1ed7bf9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080615 Jul 28 03:53:38.893958 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 958/1362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:38 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:39.468703 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3ddf5acb-5682-40e0-b9b0-9406e42c38d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:39.469367 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3ddf5acb-5682-40e0-b9b0-9406e42c38d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:39.476117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ddf5acb-5682-40e0-b9b0-9406e42c38d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:39.476560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ddf5acb-5682-40e0-b9b0-9406e42c38d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:39.477316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ddf5acb-5682-40e0-b9b0-9406e42c38d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:39.477745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ddf5acb-5682-40e0-b9b0-9406e42c38d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:39.541672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3ddf5acb-5682-40e0-b9b0-9406e42c38d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:39.549450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3ddf5acb-5682-40e0-b9b0-9406e42c38d0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.084382 Jul 28 03:53:39.549996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 959/1363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:39 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:39.910860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-76d874bc-d88e-4b67-9c26-b7ee8e56a02a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:39.911465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-76d874bc-d88e-4b67-9c26-b7ee8e56a02a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:39.917147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76d874bc-d88e-4b67-9c26-b7ee8e56a02a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:39.917591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76d874bc-d88e-4b67-9c26-b7ee8e56a02a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:39.918346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76d874bc-d88e-4b67-9c26-b7ee8e56a02a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:39.918775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-76d874bc-d88e-4b67-9c26-b7ee8e56a02a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:39.977686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-76d874bc-d88e-4b67-9c26-b7ee8e56a02a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:39.985339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-76d874bc-d88e-4b67-9c26-b7ee8e56a02a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078719 Jul 28 03:53:39.985890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 960/1364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:39 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:40.567282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c9d5ae7f-6063-4f22-b65f-502b80da3240 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:40.568030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c9d5ae7f-6063-4f22-b65f-502b80da3240 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:40.573774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9d5ae7f-6063-4f22-b65f-502b80da3240 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:40.574223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9d5ae7f-6063-4f22-b65f-502b80da3240 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:40.574989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9d5ae7f-6063-4f22-b65f-502b80da3240 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:40.575423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c9d5ae7f-6063-4f22-b65f-502b80da3240 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:40.633904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c9d5ae7f-6063-4f22-b65f-502b80da3240 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.641726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c9d5ae7f-6063-4f22-b65f-502b80da3240 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078902 Jul 28 03:53:40.642430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 961/1365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:40 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:41.001187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b2b142c7-fee6-42f6-9bf1-6c40d3ececcb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:41.001790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b2b142c7-fee6-42f6-9bf1-6c40d3ececcb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:41.007961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2b142c7-fee6-42f6-9bf1-6c40d3ececcb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:41.008412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2b142c7-fee6-42f6-9bf1-6c40d3ececcb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:41.009180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2b142c7-fee6-42f6-9bf1-6c40d3ececcb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:41.009614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b2b142c7-fee6-42f6-9bf1-6c40d3ececcb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:41.068962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b2b142c7-fee6-42f6-9bf1-6c40d3ececcb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.076469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b2b142c7-fee6-42f6-9bf1-6c40d3ececcb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078911 Jul 28 03:53:41.077021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 962/1366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:40 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:41.658407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-99b6451f-c5e4-40bb-85c8-a778d201717c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:41.659037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-99b6451f-c5e4-40bb-85c8-a778d201717c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:41.664880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99b6451f-c5e4-40bb-85c8-a778d201717c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:41.665332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99b6451f-c5e4-40bb-85c8-a778d201717c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:41.666093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99b6451f-c5e4-40bb-85c8-a778d201717c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:41.666527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99b6451f-c5e4-40bb-85c8-a778d201717c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:41.725005 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-99b6451f-c5e4-40bb-85c8-a778d201717c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.732881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-99b6451f-c5e4-40bb-85c8-a778d201717c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078189 Jul 28 03:53:41.733433 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 963/1367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:41 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:42.092847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-34db3f2a-a185-4f2a-b5bd-b56f250b270a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:42.093462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-34db3f2a-a185-4f2a-b5bd-b56f250b270a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:42.099296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34db3f2a-a185-4f2a-b5bd-b56f250b270a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:42.099774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34db3f2a-a185-4f2a-b5bd-b56f250b270a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:42.100810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34db3f2a-a185-4f2a-b5bd-b56f250b270a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:42.101241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34db3f2a-a185-4f2a-b5bd-b56f250b270a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:42.160210 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-34db3f2a-a185-4f2a-b5bd-b56f250b270a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:42.168036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-34db3f2a-a185-4f2a-b5bd-b56f250b270a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078686 Jul 28 03:53:42.168596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 964/1368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:42 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:42.749862 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6dad1287-0573-40e8-b52b-00c2e7355989 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:42.750530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6dad1287-0573-40e8-b52b-00c2e7355989 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:42.756449 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6dad1287-0573-40e8-b52b-00c2e7355989 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:42.756891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6dad1287-0573-40e8-b52b-00c2e7355989 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:42.757645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6dad1287-0573-40e8-b52b-00c2e7355989 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:42.758071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6dad1287-0573-40e8-b52b-00c2e7355989 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:42.820142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6dad1287-0573-40e8-b52b-00c2e7355989 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:42.827726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6dad1287-0573-40e8-b52b-00c2e7355989 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081492 Jul 28 03:53:42.828275 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 965/1369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:42 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:43.185287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c6150df0-76b4-4480-91f9-f50a010237f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:43.185892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c6150df0-76b4-4480-91f9-f50a010237f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:43.192619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6150df0-76b4-4480-91f9-f50a010237f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:43.193060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6150df0-76b4-4480-91f9-f50a010237f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:43.193818 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6150df0-76b4-4480-91f9-f50a010237f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:43.194245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c6150df0-76b4-4480-91f9-f50a010237f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:43.253773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c6150df0-76b4-4480-91f9-f50a010237f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.261407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c6150df0-76b4-4480-91f9-f50a010237f0 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079761 Jul 28 03:53:43.261957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 966/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:43 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:43.844827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a0e4565a-63de-4668-b293-3a49fe44a148 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:43.845481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a0e4565a-63de-4668-b293-3a49fe44a148 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:43.852496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a0e4565a-63de-4668-b293-3a49fe44a148 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:43.852937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a0e4565a-63de-4668-b293-3a49fe44a148 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:43.853693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a0e4565a-63de-4668-b293-3a49fe44a148 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:43.854123 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a0e4565a-63de-4668-b293-3a49fe44a148 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:43.913357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a0e4565a-63de-4668-b293-3a49fe44a148 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.920910 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a0e4565a-63de-4668-b293-3a49fe44a148 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079758 Jul 28 03:53:43.921458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 967/1371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:43 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:44.277863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0e6ada9e-62ff-4f86-9e2b-7335677f2e92 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:44.278507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0e6ada9e-62ff-4f86-9e2b-7335677f2e92 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:44.284329 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0e6ada9e-62ff-4f86-9e2b-7335677f2e92 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:44.284784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0e6ada9e-62ff-4f86-9e2b-7335677f2e92 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:44.285601 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0e6ada9e-62ff-4f86-9e2b-7335677f2e92 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:44.286038 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0e6ada9e-62ff-4f86-9e2b-7335677f2e92 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:44.344779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0e6ada9e-62ff-4f86-9e2b-7335677f2e92 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:44.352790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0e6ada9e-62ff-4f86-9e2b-7335677f2e92 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078620 Jul 28 03:53:44.353347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 968/1372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:44 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:44.937611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d84f5aa5-653f-47f9-b53b-87bc6d0ed7f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:44.938259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d84f5aa5-653f-47f9-b53b-87bc6d0ed7f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:44.944510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d84f5aa5-653f-47f9-b53b-87bc6d0ed7f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:44.944968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d84f5aa5-653f-47f9-b53b-87bc6d0ed7f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:44.945739 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d84f5aa5-653f-47f9-b53b-87bc6d0ed7f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:44.946176 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d84f5aa5-653f-47f9-b53b-87bc6d0ed7f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:45.008999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d84f5aa5-653f-47f9-b53b-87bc6d0ed7f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:45.016888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d84f5aa5-653f-47f9-b53b-87bc6d0ed7f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.083089 Jul 28 03:53:45.017444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 969/1373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:44 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:45.369897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d01113a0-8b45-42bb-8fd0-378cbc4a1d4b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:45.370533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d01113a0-8b45-42bb-8fd0-378cbc4a1d4b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:45.376546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d01113a0-8b45-42bb-8fd0-378cbc4a1d4b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:45.376998 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d01113a0-8b45-42bb-8fd0-378cbc4a1d4b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:45.377765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d01113a0-8b45-42bb-8fd0-378cbc4a1d4b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:45.378224 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d01113a0-8b45-42bb-8fd0-378cbc4a1d4b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:45.437316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d01113a0-8b45-42bb-8fd0-378cbc4a1d4b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:45.445741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d01113a0-8b45-42bb-8fd0-378cbc4a1d4b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079751 Jul 28 03:53:45.446351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 970/1374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:45 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:46.034196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e0e50872-ed05-49f4-9b10-2ddd2c4f7680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:46.034836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e0e50872-ed05-49f4-9b10-2ddd2c4f7680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:46.040638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0e50872-ed05-49f4-9b10-2ddd2c4f7680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:46.041096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0e50872-ed05-49f4-9b10-2ddd2c4f7680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:46.041870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0e50872-ed05-49f4-9b10-2ddd2c4f7680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:46.042312 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e0e50872-ed05-49f4-9b10-2ddd2c4f7680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:46.105403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e0e50872-ed05-49f4-9b10-2ddd2c4f7680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:46.113231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e0e50872-ed05-49f4-9b10-2ddd2c4f7680 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082713 Jul 28 03:53:46.113786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 971/1375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:46 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:46.461668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-141e4925-5bb3-4a9f-bec8-ed87ce6195bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:46.462268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-141e4925-5bb3-4a9f-bec8-ed87ce6195bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:46.468063 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-141e4925-5bb3-4a9f-bec8-ed87ce6195bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:46.468507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-141e4925-5bb3-4a9f-bec8-ed87ce6195bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:46.469266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-141e4925-5bb3-4a9f-bec8-ed87ce6195bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:46.469690 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-141e4925-5bb3-4a9f-bec8-ed87ce6195bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:46.529191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-141e4925-5bb3-4a9f-bec8-ed87ce6195bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:46.537575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-141e4925-5bb3-4a9f-bec8-ed87ce6195bb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079533 Jul 28 03:53:46.538126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 972/1376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:46 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:47.131126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f3677c01-ae55-43fb-acf0-3283e2294646 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:47.131802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f3677c01-ae55-43fb-acf0-3283e2294646 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:47.137834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f3677c01-ae55-43fb-acf0-3283e2294646 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:47.138351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f3677c01-ae55-43fb-acf0-3283e2294646 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:47.139257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f3677c01-ae55-43fb-acf0-3283e2294646 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:47.139803 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f3677c01-ae55-43fb-acf0-3283e2294646 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:47.199606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f3677c01-ae55-43fb-acf0-3283e2294646 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:47.208233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f3677c01-ae55-43fb-acf0-3283e2294646 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081286 Jul 28 03:53:47.208791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 973/1377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:47 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:47.554223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e4380ad8-fe8e-4b4e-a997-7c2fb4e8689b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:47.554783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e4380ad8-fe8e-4b4e-a997-7c2fb4e8689b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:47.560511 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4380ad8-fe8e-4b4e-a997-7c2fb4e8689b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:47.560954 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4380ad8-fe8e-4b4e-a997-7c2fb4e8689b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:47.561712 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4380ad8-fe8e-4b4e-a997-7c2fb4e8689b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:47.562139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e4380ad8-fe8e-4b4e-a997-7c2fb4e8689b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:47.620965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e4380ad8-fe8e-4b4e-a997-7c2fb4e8689b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:47.628506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e4380ad8-fe8e-4b4e-a997-7c2fb4e8689b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078526 Jul 28 03:53:47.629549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 974/1378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:47 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:48.224973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9f9409c1-30d4-4bf2-8fd4-07b00e563273 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:48.225917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9f9409c1-30d4-4bf2-8fd4-07b00e563273 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:48.232761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f9409c1-30d4-4bf2-8fd4-07b00e563273 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:48.233253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f9409c1-30d4-4bf2-8fd4-07b00e563273 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:48.234078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f9409c1-30d4-4bf2-8fd4-07b00e563273 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:48.234548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f9409c1-30d4-4bf2-8fd4-07b00e563273 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:48.293886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9f9409c1-30d4-4bf2-8fd4-07b00e563273 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:48.302829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9f9409c1-30d4-4bf2-8fd4-07b00e563273 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081904 Jul 28 03:53:48.303476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 975/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:48 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:48.646058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2f1ba970-8425-4193-8bca-1499d85f33fb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:48.646672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2f1ba970-8425-4193-8bca-1499d85f33fb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:48.652432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f1ba970-8425-4193-8bca-1499d85f33fb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:48.652881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f1ba970-8425-4193-8bca-1499d85f33fb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:48.653649 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f1ba970-8425-4193-8bca-1499d85f33fb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:48.654084 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f1ba970-8425-4193-8bca-1499d85f33fb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:48.713204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2f1ba970-8425-4193-8bca-1499d85f33fb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:48.720776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2f1ba970-8425-4193-8bca-1499d85f33fb tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079142 Jul 28 03:53:48.721331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 976/1380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:48 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:49.319763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-07669ead-d59a-4dac-a2e4-212a1252c2c0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:49.320440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-07669ead-d59a-4dac-a2e4-212a1252c2c0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:49.326169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07669ead-d59a-4dac-a2e4-212a1252c2c0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:49.326612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07669ead-d59a-4dac-a2e4-212a1252c2c0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:49.327374 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07669ead-d59a-4dac-a2e4-212a1252c2c0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:49.327835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-07669ead-d59a-4dac-a2e4-212a1252c2c0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:49.390604 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-07669ead-d59a-4dac-a2e4-212a1252c2c0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:49.398296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-07669ead-d59a-4dac-a2e4-212a1252c2c0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082436 Jul 28 03:53:49.398848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 977/1381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:49 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:49.738045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b74e1bbe-0e25-483e-aac8-82f88fdb1921 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:49.738575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b74e1bbe-0e25-483e-aac8-82f88fdb1921 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:49.744317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b74e1bbe-0e25-483e-aac8-82f88fdb1921 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:49.744767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b74e1bbe-0e25-483e-aac8-82f88fdb1921 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:49.745526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b74e1bbe-0e25-483e-aac8-82f88fdb1921 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:49.745956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b74e1bbe-0e25-483e-aac8-82f88fdb1921 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:49.804217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b74e1bbe-0e25-483e-aac8-82f88fdb1921 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:49.811944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b74e1bbe-0e25-483e-aac8-82f88fdb1921 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077628 Jul 28 03:53:49.812497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 978/1382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:49 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:50.415554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fc1f3568-953f-41a8-b214-b5a151ec7bee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:50.416222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fc1f3568-953f-41a8-b214-b5a151ec7bee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:50.422030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc1f3568-953f-41a8-b214-b5a151ec7bee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:50.422461 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc1f3568-953f-41a8-b214-b5a151ec7bee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:50.423226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc1f3568-953f-41a8-b214-b5a151ec7bee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:50.423662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc1f3568-953f-41a8-b214-b5a151ec7bee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:50.483566 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fc1f3568-953f-41a8-b214-b5a151ec7bee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:50.491700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fc1f3568-953f-41a8-b214-b5a151ec7bee tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079819 Jul 28 03:53:50.492277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 979/1383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:50 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:50.828487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c547b776-d9f9-4026-9f54-145cae878f1b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:50.829021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c547b776-d9f9-4026-9f54-145cae878f1b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:50.835520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c547b776-d9f9-4026-9f54-145cae878f1b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:50.835994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c547b776-d9f9-4026-9f54-145cae878f1b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:50.836761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c547b776-d9f9-4026-9f54-145cae878f1b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:50.837192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c547b776-d9f9-4026-9f54-145cae878f1b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:50.896559 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c547b776-d9f9-4026-9f54-145cae878f1b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:50.904241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c547b776-d9f9-4026-9f54-145cae878f1b tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079399 Jul 28 03:53:50.904792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 980/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:50 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:51.507896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bf593fd7-0a6d-47be-9025-061e99e019a5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:51.508504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bf593fd7-0a6d-47be-9025-061e99e019a5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:51.514282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf593fd7-0a6d-47be-9025-061e99e019a5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:51.514728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf593fd7-0a6d-47be-9025-061e99e019a5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:51.515491 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf593fd7-0a6d-47be-9025-061e99e019a5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:51.515951 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf593fd7-0a6d-47be-9025-061e99e019a5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:51.574411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bf593fd7-0a6d-47be-9025-061e99e019a5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:51.582009 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bf593fd7-0a6d-47be-9025-061e99e019a5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.077792 Jul 28 03:53:51.582666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 981/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:51 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:51.921082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6dbb1ce0-4165-461c-93dd-bc2437e7058a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:51.921692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6dbb1ce0-4165-461c-93dd-bc2437e7058a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:51.927458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6dbb1ce0-4165-461c-93dd-bc2437e7058a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:51.927938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6dbb1ce0-4165-461c-93dd-bc2437e7058a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:51.928708 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6dbb1ce0-4165-461c-93dd-bc2437e7058a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:51.929142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6dbb1ce0-4165-461c-93dd-bc2437e7058a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:51.987336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6dbb1ce0-4165-461c-93dd-bc2437e7058a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:51.995551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6dbb1ce0-4165-461c-93dd-bc2437e7058a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077992 Jul 28 03:53:51.996180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 982/1386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:51 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:52.599270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4dc8303e-569a-40cd-b70f-d34a7010f093 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:52.600009 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4dc8303e-569a-40cd-b70f-d34a7010f093 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:52.606131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4dc8303e-569a-40cd-b70f-d34a7010f093 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:52.606575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4dc8303e-569a-40cd-b70f-d34a7010f093 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:52.607337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4dc8303e-569a-40cd-b70f-d34a7010f093 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:52.607802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4dc8303e-569a-40cd-b70f-d34a7010f093 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:52.669741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4dc8303e-569a-40cd-b70f-d34a7010f093 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:52.677734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4dc8303e-569a-40cd-b70f-d34a7010f093 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082783 Jul 28 03:53:52.678296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 983/1387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:52 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:53.013074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-749050ec-7ebb-4604-9c04-2fcb50ede2ce tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:53.013608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-749050ec-7ebb-4604-9c04-2fcb50ede2ce tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:53.020313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-749050ec-7ebb-4604-9c04-2fcb50ede2ce tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:53.020760 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-749050ec-7ebb-4604-9c04-2fcb50ede2ce tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:53.021532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-749050ec-7ebb-4604-9c04-2fcb50ede2ce tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:53.021972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-749050ec-7ebb-4604-9c04-2fcb50ede2ce tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:53.082896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-749050ec-7ebb-4604-9c04-2fcb50ede2ce tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:53.090556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-749050ec-7ebb-4604-9c04-2fcb50ede2ce tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.081240 Jul 28 03:53:53.091112 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 984/1388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:53 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:53.694354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b3296f71-23a2-4784-b604-826d9cc9a1a3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:53.695008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b3296f71-23a2-4784-b604-826d9cc9a1a3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:53.700738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b3296f71-23a2-4784-b604-826d9cc9a1a3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:53.701182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b3296f71-23a2-4784-b604-826d9cc9a1a3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:53.701938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b3296f71-23a2-4784-b604-826d9cc9a1a3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:53.702370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b3296f71-23a2-4784-b604-826d9cc9a1a3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:53.761273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b3296f71-23a2-4784-b604-826d9cc9a1a3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:53.768862 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b3296f71-23a2-4784-b604-826d9cc9a1a3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078900 Jul 28 03:53:53.770121 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 985/1389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:53 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:54.107518 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-98161d47-a047-4fee-8203-cd388904a490 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:54.108179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-98161d47-a047-4fee-8203-cd388904a490 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:54.114454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98161d47-a047-4fee-8203-cd388904a490 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:54.114890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98161d47-a047-4fee-8203-cd388904a490 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:54.115645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98161d47-a047-4fee-8203-cd388904a490 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:54.116104 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-98161d47-a047-4fee-8203-cd388904a490 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:54.174227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-98161d47-a047-4fee-8203-cd388904a490 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:54.182517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-98161d47-a047-4fee-8203-cd388904a490 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078669 Jul 28 03:53:54.183071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 986/1390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:54 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:54.787677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-008726e0-18ed-4409-94d7-bce96c525b12 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:54.788432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-008726e0-18ed-4409-94d7-bce96c525b12 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:54.794034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-008726e0-18ed-4409-94d7-bce96c525b12 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:54.794479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-008726e0-18ed-4409-94d7-bce96c525b12 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:54.795233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-008726e0-18ed-4409-94d7-bce96c525b12 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:54.795660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-008726e0-18ed-4409-94d7-bce96c525b12 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:54.854957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-008726e0-18ed-4409-94d7-bce96c525b12 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:54.865310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-008726e0-18ed-4409-94d7-bce96c525b12 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082129 Jul 28 03:53:54.866023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 987/1391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:54 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:55.200336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4905488b-63a2-4337-be47-7c6ceb556e8a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:55.200939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4905488b-63a2-4337-be47-7c6ceb556e8a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:55.207031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4905488b-63a2-4337-be47-7c6ceb556e8a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:55.207474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4905488b-63a2-4337-be47-7c6ceb556e8a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:55.208282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4905488b-63a2-4337-be47-7c6ceb556e8a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:55.208715 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4905488b-63a2-4337-be47-7c6ceb556e8a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:55.268180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4905488b-63a2-4337-be47-7c6ceb556e8a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:55.275890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4905488b-63a2-4337-be47-7c6ceb556e8a tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079160 Jul 28 03:53:55.276448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 988/1392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:55 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:55.883816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-52609efe-7b87-44bc-b8e0-0fb03c7d89cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:55.884499 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-52609efe-7b87-44bc-b8e0-0fb03c7d89cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:55.890271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-52609efe-7b87-44bc-b8e0-0fb03c7d89cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:55.890729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-52609efe-7b87-44bc-b8e0-0fb03c7d89cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:55.891498 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-52609efe-7b87-44bc-b8e0-0fb03c7d89cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:55.891960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-52609efe-7b87-44bc-b8e0-0fb03c7d89cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:55.954544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-52609efe-7b87-44bc-b8e0-0fb03c7d89cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:55.962848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-52609efe-7b87-44bc-b8e0-0fb03c7d89cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082716 Jul 28 03:53:55.963405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 989/1393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:55 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:56.293331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-55361ab4-6df4-4749-a791-0bd4910d8f34 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:56.293867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-55361ab4-6df4-4749-a791-0bd4910d8f34 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:56.299593 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-55361ab4-6df4-4749-a791-0bd4910d8f34 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:56.300065 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-55361ab4-6df4-4749-a791-0bd4910d8f34 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:56.300850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-55361ab4-6df4-4749-a791-0bd4910d8f34 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:56.301273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-55361ab4-6df4-4749-a791-0bd4910d8f34 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:56.360078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-55361ab4-6df4-4749-a791-0bd4910d8f34 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:56.368058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-55361ab4-6df4-4749-a791-0bd4910d8f34 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078404 Jul 28 03:53:56.368618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 990/1394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:56 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:56.979473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7f8f1f3c-792b-4a5b-9908-848026caaeca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:56.980166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7f8f1f3c-792b-4a5b-9908-848026caaeca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:56.985849 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f8f1f3c-792b-4a5b-9908-848026caaeca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:56.986287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f8f1f3c-792b-4a5b-9908-848026caaeca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:56.987040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f8f1f3c-792b-4a5b-9908-848026caaeca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:56.987475 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7f8f1f3c-792b-4a5b-9908-848026caaeca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:57.046472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7f8f1f3c-792b-4a5b-9908-848026caaeca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:57.054983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7f8f1f3c-792b-4a5b-9908-848026caaeca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079325 Jul 28 03:53:57.055537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 991/1395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:56 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:57.384590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e70fcde9-7c21-445d-a3fd-3f6bde1c6b54 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:57.385199 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e70fcde9-7c21-445d-a3fd-3f6bde1c6b54 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:57.390921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e70fcde9-7c21-445d-a3fd-3f6bde1c6b54 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:57.391361 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e70fcde9-7c21-445d-a3fd-3f6bde1c6b54 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:57.392152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e70fcde9-7c21-445d-a3fd-3f6bde1c6b54 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:57.392576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e70fcde9-7c21-445d-a3fd-3f6bde1c6b54 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:57.451179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e70fcde9-7c21-445d-a3fd-3f6bde1c6b54 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:57.458981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e70fcde9-7c21-445d-a3fd-3f6bde1c6b54 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078016 Jul 28 03:53:57.459542 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 992/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:57 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:58.071624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-61d71694-cb71-4ffe-b664-f9298ca242f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:58.072174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-61d71694-cb71-4ffe-b664-f9298ca242f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:58.077948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-61d71694-cb71-4ffe-b664-f9298ca242f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:58.078399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-61d71694-cb71-4ffe-b664-f9298ca242f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:58.079181 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-61d71694-cb71-4ffe-b664-f9298ca242f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:58.079646 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-61d71694-cb71-4ffe-b664-f9298ca242f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:58.140170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-61d71694-cb71-4ffe-b664-f9298ca242f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:58.148857 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-61d71694-cb71-4ffe-b664-f9298ca242f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.080918 Jul 28 03:53:58.149420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 993/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:58 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:58.476031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3436be84-39ea-42d0-8ff3-6ab19bbfb878 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:58.476641 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3436be84-39ea-42d0-8ff3-6ab19bbfb878 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:58.482453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3436be84-39ea-42d0-8ff3-6ab19bbfb878 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:58.482901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3436be84-39ea-42d0-8ff3-6ab19bbfb878 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:58.483661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3436be84-39ea-42d0-8ff3-6ab19bbfb878 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:58.484128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3436be84-39ea-42d0-8ff3-6ab19bbfb878 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:58.543422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3436be84-39ea-42d0-8ff3-6ab19bbfb878 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:58.551458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3436be84-39ea-42d0-8ff3-6ab19bbfb878 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079364 Jul 28 03:53:58.552045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 994/1398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:58 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:59.165853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4a61904c-8185-44a0-b46b-835c31dbd0d7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:59.166459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4a61904c-8185-44a0-b46b-835c31dbd0d7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:59.172359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a61904c-8185-44a0-b46b-835c31dbd0d7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:59.172804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a61904c-8185-44a0-b46b-835c31dbd0d7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:59.173563 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a61904c-8185-44a0-b46b-835c31dbd0d7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:59.173989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4a61904c-8185-44a0-b46b-835c31dbd0d7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:59.236729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4a61904c-8185-44a0-b46b-835c31dbd0d7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:59.245080 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4a61904c-8185-44a0-b46b-835c31dbd0d7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082915 Jul 28 03:53:59.245638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 995/1399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:59 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:59.568135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1213667c-888c-4500-8641-91bc42fe76fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:59.568757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1213667c-888c-4500-8641-91bc42fe76fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:53:59.574570 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1213667c-888c-4500-8641-91bc42fe76fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:59.575021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1213667c-888c-4500-8641-91bc42fe76fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:59.575884 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1213667c-888c-4500-8641-91bc42fe76fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:53:59.576326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1213667c-888c-4500-8641-91bc42fe76fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:53:59.636812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1213667c-888c-4500-8641-91bc42fe76fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:59.645067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1213667c-888c-4500-8641-91bc42fe76fc tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080628 Jul 28 03:53:59.645688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 996/1400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:53:59 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:00.261657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f508127b-001c-435f-96ba-2fa1e89ce519 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:00.262299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f508127b-001c-435f-96ba-2fa1e89ce519 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:00.268043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f508127b-001c-435f-96ba-2fa1e89ce519 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:00.268488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f508127b-001c-435f-96ba-2fa1e89ce519 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:00.269719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f508127b-001c-435f-96ba-2fa1e89ce519 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:00.270151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f508127b-001c-435f-96ba-2fa1e89ce519 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:00.328556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f508127b-001c-435f-96ba-2fa1e89ce519 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:00.336213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f508127b-001c-435f-96ba-2fa1e89ce519 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078207 Jul 28 03:54:00.336764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 997/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:00 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:00.661984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-57ce9687-87ae-41ed-b45b-61be7d085aa8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:00.662587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-57ce9687-87ae-41ed-b45b-61be7d085aa8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:00.668312 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57ce9687-87ae-41ed-b45b-61be7d085aa8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:00.668752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57ce9687-87ae-41ed-b45b-61be7d085aa8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:00.669506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57ce9687-87ae-41ed-b45b-61be7d085aa8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:00.669933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57ce9687-87ae-41ed-b45b-61be7d085aa8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:00.729266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-57ce9687-87ae-41ed-b45b-61be7d085aa8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:00.736809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-57ce9687-87ae-41ed-b45b-61be7d085aa8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078926 Jul 28 03:54:00.737363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 998/1402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:00 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:01.353104 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fd8f1f7c-08b4-418b-ad4d-b070ce920d89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:01.353736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fd8f1f7c-08b4-418b-ad4d-b070ce920d89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:01.359909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fd8f1f7c-08b4-418b-ad4d-b070ce920d89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:01.360363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fd8f1f7c-08b4-418b-ad4d-b070ce920d89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:01.361156 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fd8f1f7c-08b4-418b-ad4d-b070ce920d89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:01.361596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fd8f1f7c-08b4-418b-ad4d-b070ce920d89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:01.421996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fd8f1f7c-08b4-418b-ad4d-b070ce920d89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:01.429902 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fd8f1f7c-08b4-418b-ad4d-b070ce920d89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.080859 Jul 28 03:54:01.430475 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 999/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:01 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:01.754805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-96925a83-232b-47bf-965c-9c66dbc00b03 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:01.755345 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-96925a83-232b-47bf-965c-9c66dbc00b03 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:01.761094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96925a83-232b-47bf-965c-9c66dbc00b03 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:01.761547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96925a83-232b-47bf-965c-9c66dbc00b03 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:01.762312 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96925a83-232b-47bf-965c-9c66dbc00b03 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:01.762750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-96925a83-232b-47bf-965c-9c66dbc00b03 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:01.826606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-96925a83-232b-47bf-965c-9c66dbc00b03 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:01.834459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-96925a83-232b-47bf-965c-9c66dbc00b03 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.083938 Jul 28 03:54:01.835015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1000/1404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:01 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:02.446821 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-92e4766d-35fa-41c3-95a7-b8e393089fe9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:02.447462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-92e4766d-35fa-41c3-95a7-b8e393089fe9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:02.453148 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92e4766d-35fa-41c3-95a7-b8e393089fe9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:02.453589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92e4766d-35fa-41c3-95a7-b8e393089fe9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:02.454346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92e4766d-35fa-41c3-95a7-b8e393089fe9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:02.454773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-92e4766d-35fa-41c3-95a7-b8e393089fe9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:02.516807 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-92e4766d-35fa-41c3-95a7-b8e393089fe9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:02.526738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-92e4766d-35fa-41c3-95a7-b8e393089fe9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.083570 Jul 28 03:54:02.527287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1001/1405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:02 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:02.851107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-df5b2083-e9a3-4a58-b40d-b9fef15fa4df tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:02.851733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-df5b2083-e9a3-4a58-b40d-b9fef15fa4df tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:02.857518 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df5b2083-e9a3-4a58-b40d-b9fef15fa4df tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:02.857962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df5b2083-e9a3-4a58-b40d-b9fef15fa4df tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:02.858718 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df5b2083-e9a3-4a58-b40d-b9fef15fa4df tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:02.859142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-df5b2083-e9a3-4a58-b40d-b9fef15fa4df tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:02.917226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-df5b2083-e9a3-4a58-b40d-b9fef15fa4df tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:02.924640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-df5b2083-e9a3-4a58-b40d-b9fef15fa4df tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077463 Jul 28 03:54:02.925236 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1002/1406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:02 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:03.544061 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-53c6749d-f1f0-45db-8704-90a9f7c7d65f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:03.544717 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-53c6749d-f1f0-45db-8704-90a9f7c7d65f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:03.550936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53c6749d-f1f0-45db-8704-90a9f7c7d65f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:03.551520 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53c6749d-f1f0-45db-8704-90a9f7c7d65f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:03.552320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53c6749d-f1f0-45db-8704-90a9f7c7d65f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:03.552762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53c6749d-f1f0-45db-8704-90a9f7c7d65f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:03.611509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-53c6749d-f1f0-45db-8704-90a9f7c7d65f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:03.620467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-53c6749d-f1f0-45db-8704-90a9f7c7d65f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079869 Jul 28 03:54:03.621030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1003/1407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:03 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:03.941736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-81cb532b-8ec7-455b-9057-9e75b944a353 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:03.942702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-81cb532b-8ec7-455b-9057-9e75b944a353 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:03.948790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81cb532b-8ec7-455b-9057-9e75b944a353 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:03.949241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81cb532b-8ec7-455b-9057-9e75b944a353 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:03.950012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81cb532b-8ec7-455b-9057-9e75b944a353 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:03.950446 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-81cb532b-8ec7-455b-9057-9e75b944a353 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:04.010962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-81cb532b-8ec7-455b-9057-9e75b944a353 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:04.019410 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-81cb532b-8ec7-455b-9057-9e75b944a353 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.081008 Jul 28 03:54:04.020136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1004/1408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:03 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:04.637024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7b722222-f452-436d-87f0-a7fd44ac0f5b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:04.637665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7b722222-f452-436d-87f0-a7fd44ac0f5b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:04.643543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7b722222-f452-436d-87f0-a7fd44ac0f5b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:04.644036 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7b722222-f452-436d-87f0-a7fd44ac0f5b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:04.644793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7b722222-f452-436d-87f0-a7fd44ac0f5b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:04.645226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7b722222-f452-436d-87f0-a7fd44ac0f5b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:04.703876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7b722222-f452-436d-87f0-a7fd44ac0f5b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:04.711585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7b722222-f452-436d-87f0-a7fd44ac0f5b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078247 Jul 28 03:54:04.712174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1005/1409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:04 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:05.036451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ff554e08-807a-495c-9bb6-db0020789241 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:05.036989 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ff554e08-807a-495c-9bb6-db0020789241 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:05.042713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ff554e08-807a-495c-9bb6-db0020789241 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:05.043154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ff554e08-807a-495c-9bb6-db0020789241 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:05.043936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ff554e08-807a-495c-9bb6-db0020789241 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:05.044365 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ff554e08-807a-495c-9bb6-db0020789241 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:05.104050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ff554e08-807a-495c-9bb6-db0020789241 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:05.111676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ff554e08-807a-495c-9bb6-db0020789241 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079402 Jul 28 03:54:05.112249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1006/1410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:05 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:05.728489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-85fe3b63-e8ad-4aff-8e28-d1b08d7e6bc7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:05.729080 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-85fe3b63-e8ad-4aff-8e28-d1b08d7e6bc7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:05.734765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85fe3b63-e8ad-4aff-8e28-d1b08d7e6bc7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:05.735212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85fe3b63-e8ad-4aff-8e28-d1b08d7e6bc7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:05.736001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85fe3b63-e8ad-4aff-8e28-d1b08d7e6bc7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:05.736436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-85fe3b63-e8ad-4aff-8e28-d1b08d7e6bc7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:05.797679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-85fe3b63-e8ad-4aff-8e28-d1b08d7e6bc7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:05.805450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-85fe3b63-e8ad-4aff-8e28-d1b08d7e6bc7 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081043 Jul 28 03:54:05.806008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1007/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:05 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:06.129081 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fc676dfa-fdf5-4b83-8517-ba3e136cfd00 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:06.129692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fc676dfa-fdf5-4b83-8517-ba3e136cfd00 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:06.135477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc676dfa-fdf5-4b83-8517-ba3e136cfd00 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:06.136038 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc676dfa-fdf5-4b83-8517-ba3e136cfd00 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:06.136805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc676dfa-fdf5-4b83-8517-ba3e136cfd00 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:06.137238 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fc676dfa-fdf5-4b83-8517-ba3e136cfd00 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:06.196631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fc676dfa-fdf5-4b83-8517-ba3e136cfd00 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:06.204201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fc676dfa-fdf5-4b83-8517-ba3e136cfd00 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079369 Jul 28 03:54:06.204755 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1008/1412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:06 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:06.821869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0f2ad0c8-0021-491f-ac99-32168d30828a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:06.822553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0f2ad0c8-0021-491f-ac99-32168d30828a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:06.828207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f2ad0c8-0021-491f-ac99-32168d30828a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:06.828652 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f2ad0c8-0021-491f-ac99-32168d30828a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:06.829407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f2ad0c8-0021-491f-ac99-32168d30828a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:06.829838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f2ad0c8-0021-491f-ac99-32168d30828a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:06.888258 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0f2ad0c8-0021-491f-ac99-32168d30828a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:06.896415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0f2ad0c8-0021-491f-ac99-32168d30828a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078196 Jul 28 03:54:06.896969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1009/1413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:06 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:07.220981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-11d3c406-d291-4ab5-b3bd-0360f68312fe tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.221637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-11d3c406-d291-4ab5-b3bd-0360f68312fe tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:07.227904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11d3c406-d291-4ab5-b3bd-0360f68312fe tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:07.228360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11d3c406-d291-4ab5-b3bd-0360f68312fe tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:07.229127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11d3c406-d291-4ab5-b3bd-0360f68312fe tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:07.229564 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-11d3c406-d291-4ab5-b3bd-0360f68312fe tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:07.288243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-11d3c406-d291-4ab5-b3bd-0360f68312fe tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:07.295823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-11d3c406-d291-4ab5-b3bd-0360f68312fe tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078503 Jul 28 03:54:07.296380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1010/1414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:07 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:07.437242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:54:07.437242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 03:54:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 03:54:07.913398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4fdb944d-96cc-4850-a1c5-097e11c9427a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.914133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4fdb944d-96cc-4850-a1c5-097e11c9427a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:07.919668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fdb944d-96cc-4850-a1c5-097e11c9427a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:07.920143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fdb944d-96cc-4850-a1c5-097e11c9427a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:07.920904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fdb944d-96cc-4850-a1c5-097e11c9427a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:07.921334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4fdb944d-96cc-4850-a1c5-097e11c9427a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:07.979864 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4fdb944d-96cc-4850-a1c5-097e11c9427a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:07.987332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4fdb944d-96cc-4850-a1c5-097e11c9427a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078436 Jul 28 03:54:07.988688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1011/1415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:07 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:08.312467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-826904f9-edc5-425d-a5e5-735cb6dc3195 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:08.313041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-826904f9-edc5-425d-a5e5-735cb6dc3195 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:08.318933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-826904f9-edc5-425d-a5e5-735cb6dc3195 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:08.319378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-826904f9-edc5-425d-a5e5-735cb6dc3195 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:08.320160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-826904f9-edc5-425d-a5e5-735cb6dc3195 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:08.320591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-826904f9-edc5-425d-a5e5-735cb6dc3195 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:08.378888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-826904f9-edc5-425d-a5e5-735cb6dc3195 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:08.386648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-826904f9-edc5-425d-a5e5-735cb6dc3195 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077935 Jul 28 03:54:08.387240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1012/1416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:08 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:09.005267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ac598cfa-1e9f-4377-922e-a019c5e880dd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:09.005952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ac598cfa-1e9f-4377-922e-a019c5e880dd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:09.011698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac598cfa-1e9f-4377-922e-a019c5e880dd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:09.012178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac598cfa-1e9f-4377-922e-a019c5e880dd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:09.012947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac598cfa-1e9f-4377-922e-a019c5e880dd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:09.013388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac598cfa-1e9f-4377-922e-a019c5e880dd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:09.075735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ac598cfa-1e9f-4377-922e-a019c5e880dd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:09.083629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ac598cfa-1e9f-4377-922e-a019c5e880dd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082754 Jul 28 03:54:09.084213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1013/1417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:08 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:09.403994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1d76845a-e2b9-4d3b-9fd6-c973fff9b503 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:09.404637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1d76845a-e2b9-4d3b-9fd6-c973fff9b503 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:09.411050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1d76845a-e2b9-4d3b-9fd6-c973fff9b503 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:09.411496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1d76845a-e2b9-4d3b-9fd6-c973fff9b503 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:09.412334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1d76845a-e2b9-4d3b-9fd6-c973fff9b503 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:09.412754 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1d76845a-e2b9-4d3b-9fd6-c973fff9b503 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:09.471041 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1d76845a-e2b9-4d3b-9fd6-c973fff9b503 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:09.479390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1d76845a-e2b9-4d3b-9fd6-c973fff9b503 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079062 Jul 28 03:54:09.479963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1014/1418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:09 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:10.101277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-14ed6b7b-3472-4437-8406-9037f289d631 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:10.101881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-14ed6b7b-3472-4437-8406-9037f289d631 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:10.107683 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14ed6b7b-3472-4437-8406-9037f289d631 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:10.108153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14ed6b7b-3472-4437-8406-9037f289d631 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:10.108913 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14ed6b7b-3472-4437-8406-9037f289d631 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:10.109341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-14ed6b7b-3472-4437-8406-9037f289d631 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:10.169354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-14ed6b7b-3472-4437-8406-9037f289d631 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:10.178559 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-14ed6b7b-3472-4437-8406-9037f289d631 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082053 Jul 28 03:54:10.179119 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1015/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:10 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:10.498371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5b0b9a04-03b8-496d-b5a5-4beef9938065 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:10.499107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5b0b9a04-03b8-496d-b5a5-4beef9938065 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:10.506268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b0b9a04-03b8-496d-b5a5-4beef9938065 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:10.506723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b0b9a04-03b8-496d-b5a5-4beef9938065 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:10.507510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b0b9a04-03b8-496d-b5a5-4beef9938065 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:10.507966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b0b9a04-03b8-496d-b5a5-4beef9938065 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:10.578352 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5b0b9a04-03b8-496d-b5a5-4beef9938065 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:10.590538 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5b0b9a04-03b8-496d-b5a5-4beef9938065 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.096225 Jul 28 03:54:10.591088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1016/1420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:10 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:11.197203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7e12016c-4471-4bbe-8753-409efd2fc1f2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:11.197886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7e12016c-4471-4bbe-8753-409efd2fc1f2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:11.203626 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e12016c-4471-4bbe-8753-409efd2fc1f2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:11.204109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e12016c-4471-4bbe-8753-409efd2fc1f2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:11.204885 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e12016c-4471-4bbe-8753-409efd2fc1f2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:11.205324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7e12016c-4471-4bbe-8753-409efd2fc1f2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:11.264995 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7e12016c-4471-4bbe-8753-409efd2fc1f2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:11.272809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7e12016c-4471-4bbe-8753-409efd2fc1f2 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079284 Jul 28 03:54:11.273380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1017/1421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:11 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:11.608223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-06b57463-a581-460f-b6ec-dd09a26d5e74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:11.608853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-06b57463-a581-460f-b6ec-dd09a26d5e74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:11.615185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06b57463-a581-460f-b6ec-dd09a26d5e74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:11.615637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06b57463-a581-460f-b6ec-dd09a26d5e74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:11.616433 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06b57463-a581-460f-b6ec-dd09a26d5e74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:11.616873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06b57463-a581-460f-b6ec-dd09a26d5e74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:11.674405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-06b57463-a581-460f-b6ec-dd09a26d5e74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:11.682556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-06b57463-a581-460f-b6ec-dd09a26d5e74 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077965 Jul 28 03:54:11.683111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1018/1422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:11 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:12.289580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4b96677a-3792-4922-9bb6-754bafa64b77 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:12.290241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4b96677a-3792-4922-9bb6-754bafa64b77 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:12.295811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b96677a-3792-4922-9bb6-754bafa64b77 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:12.296248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b96677a-3792-4922-9bb6-754bafa64b77 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:12.297002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b96677a-3792-4922-9bb6-754bafa64b77 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:12.297430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b96677a-3792-4922-9bb6-754bafa64b77 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:12.359580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4b96677a-3792-4922-9bb6-754bafa64b77 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:12.367937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4b96677a-3792-4922-9bb6-754bafa64b77 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081982 Jul 28 03:54:12.368482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1019/1423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:12 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:12.698480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5735716a-e659-49b5-8a61-c075da536bb1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:12.699103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5735716a-e659-49b5-8a61-c075da536bb1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:12.704992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5735716a-e659-49b5-8a61-c075da536bb1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:12.705427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5735716a-e659-49b5-8a61-c075da536bb1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:12.706342 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5735716a-e659-49b5-8a61-c075da536bb1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:12.706787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5735716a-e659-49b5-8a61-c075da536bb1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:12.767812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5735716a-e659-49b5-8a61-c075da536bb1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:12.776337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5735716a-e659-49b5-8a61-c075da536bb1 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.081823 Jul 28 03:54:12.776881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1020/1424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:12 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:13.384869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5b08f5ef-248e-4ed4-a58d-1d168b2fbea6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:13.385512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5b08f5ef-248e-4ed4-a58d-1d168b2fbea6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:13.391136 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b08f5ef-248e-4ed4-a58d-1d168b2fbea6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:13.391587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b08f5ef-248e-4ed4-a58d-1d168b2fbea6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:13.392394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b08f5ef-248e-4ed4-a58d-1d168b2fbea6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:13.392837 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5b08f5ef-248e-4ed4-a58d-1d168b2fbea6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:13.451557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5b08f5ef-248e-4ed4-a58d-1d168b2fbea6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:13.459845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5b08f5ef-248e-4ed4-a58d-1d168b2fbea6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078660 Jul 28 03:54:13.460608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1021/1425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:13 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:13.793702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e768db90-d2c0-4a5b-ab5d-9f314ab84912 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:13.794229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e768db90-d2c0-4a5b-ab5d-9f314ab84912 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:13.800441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e768db90-d2c0-4a5b-ab5d-9f314ab84912 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:13.800885 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e768db90-d2c0-4a5b-ab5d-9f314ab84912 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:13.801643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e768db90-d2c0-4a5b-ab5d-9f314ab84912 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:13.802072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e768db90-d2c0-4a5b-ab5d-9f314ab84912 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:13.861713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e768db90-d2c0-4a5b-ab5d-9f314ab84912 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:13.870108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e768db90-d2c0-4a5b-ab5d-9f314ab84912 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080071 Jul 28 03:54:13.870659 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1022/1426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:13 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:14.477437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-30afed3d-c09a-43ed-ad31-b325e0bdeb8b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:14.478093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-30afed3d-c09a-43ed-ad31-b325e0bdeb8b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:14.483873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30afed3d-c09a-43ed-ad31-b325e0bdeb8b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:14.484324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30afed3d-c09a-43ed-ad31-b325e0bdeb8b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:14.485084 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30afed3d-c09a-43ed-ad31-b325e0bdeb8b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:14.485516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30afed3d-c09a-43ed-ad31-b325e0bdeb8b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:14.547354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-30afed3d-c09a-43ed-ad31-b325e0bdeb8b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:14.555629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-30afed3d-c09a-43ed-ad31-b325e0bdeb8b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082199 Jul 28 03:54:14.556205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1023/1427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:14 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:14.886419 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-30f88126-40c5-4d70-abd4-56f39e8a4f56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:14.887029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-30f88126-40c5-4d70-abd4-56f39e8a4f56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:14.892766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30f88126-40c5-4d70-abd4-56f39e8a4f56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:14.893210 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30f88126-40c5-4d70-abd4-56f39e8a4f56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:14.894311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30f88126-40c5-4d70-abd4-56f39e8a4f56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:14.894746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-30f88126-40c5-4d70-abd4-56f39e8a4f56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:14.952854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-30f88126-40c5-4d70-abd4-56f39e8a4f56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:14.960436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-30f88126-40c5-4d70-abd4-56f39e8a4f56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077585 Jul 28 03:54:14.960986 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1024/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:14 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:15.572512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1aa521ac-3fb2-4967-ba43-05a61719d58a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:15.573179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1aa521ac-3fb2-4967-ba43-05a61719d58a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:15.578923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1aa521ac-3fb2-4967-ba43-05a61719d58a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:15.579377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1aa521ac-3fb2-4967-ba43-05a61719d58a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:15.580184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1aa521ac-3fb2-4967-ba43-05a61719d58a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:15.580625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1aa521ac-3fb2-4967-ba43-05a61719d58a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:15.642687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1aa521ac-3fb2-4967-ba43-05a61719d58a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:15.651161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1aa521ac-3fb2-4967-ba43-05a61719d58a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082315 Jul 28 03:54:15.651736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1025/1429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:15 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:15.976486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-220c986a-483f-47cf-a004-79e6b1233777 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:15.977099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-220c986a-483f-47cf-a004-79e6b1233777 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:15.982855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-220c986a-483f-47cf-a004-79e6b1233777 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:15.983303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-220c986a-483f-47cf-a004-79e6b1233777 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:15.984100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-220c986a-483f-47cf-a004-79e6b1233777 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:15.984534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-220c986a-483f-47cf-a004-79e6b1233777 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:16.042498 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-220c986a-483f-47cf-a004-79e6b1233777 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:16.050705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-220c986a-483f-47cf-a004-79e6b1233777 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078011 Jul 28 03:54:16.051339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1026/1430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:15 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:16.668020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-29e1f429-f80a-46e1-ba74-b42e8af7064d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:16.668670 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-29e1f429-f80a-46e1-ba74-b42e8af7064d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:16.674397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e1f429-f80a-46e1-ba74-b42e8af7064d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:16.674850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e1f429-f80a-46e1-ba74-b42e8af7064d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:16.675773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e1f429-f80a-46e1-ba74-b42e8af7064d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:16.676214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29e1f429-f80a-46e1-ba74-b42e8af7064d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:16.735131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-29e1f429-f80a-46e1-ba74-b42e8af7064d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:16.742921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-29e1f429-f80a-46e1-ba74-b42e8af7064d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078804 Jul 28 03:54:16.743473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1027/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:16 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:17.067699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7bae80e3-4769-4075-8e82-ef4865b611c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:17.068263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7bae80e3-4769-4075-8e82-ef4865b611c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:17.073851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7bae80e3-4769-4075-8e82-ef4865b611c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:17.074290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7bae80e3-4769-4075-8e82-ef4865b611c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:17.075048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7bae80e3-4769-4075-8e82-ef4865b611c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:17.075477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7bae80e3-4769-4075-8e82-ef4865b611c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:17.134320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7bae80e3-4769-4075-8e82-ef4865b611c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:17.141898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7bae80e3-4769-4075-8e82-ef4865b611c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078395 Jul 28 03:54:17.142444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1028/1432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:17 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:17.759497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6f9dc09c-d652-4945-bd2f-a25b1736a814 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:17.760148 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6f9dc09c-d652-4945-bd2f-a25b1736a814 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:17.765959 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6f9dc09c-d652-4945-bd2f-a25b1736a814 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:17.766400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6f9dc09c-d652-4945-bd2f-a25b1736a814 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:17.767150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6f9dc09c-d652-4945-bd2f-a25b1736a814 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:17.767576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6f9dc09c-d652-4945-bd2f-a25b1736a814 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:17.826419 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6f9dc09c-d652-4945-bd2f-a25b1736a814 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:17.834228 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6f9dc09c-d652-4945-bd2f-a25b1736a814 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078327 Jul 28 03:54:17.834778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1029/1433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:17 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:18.158669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5869820d-f26e-4298-95aa-f160a40f5d17 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:18.160132 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5869820d-f26e-4298-95aa-f160a40f5d17 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:18.166007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5869820d-f26e-4298-95aa-f160a40f5d17 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:18.166451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5869820d-f26e-4298-95aa-f160a40f5d17 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:18.167216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5869820d-f26e-4298-95aa-f160a40f5d17 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:18.167643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5869820d-f26e-4298-95aa-f160a40f5d17 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:18.228368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5869820d-f26e-4298-95aa-f160a40f5d17 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:18.236004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5869820d-f26e-4298-95aa-f160a40f5d17 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080968 Jul 28 03:54:18.236551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1030/1434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:18 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:18.851565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-34730635-09c1-48f2-8da4-baaed567406f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:18.852218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-34730635-09c1-48f2-8da4-baaed567406f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:18.857969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34730635-09c1-48f2-8da4-baaed567406f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:18.858412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34730635-09c1-48f2-8da4-baaed567406f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:18.859168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34730635-09c1-48f2-8da4-baaed567406f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:18.859599 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-34730635-09c1-48f2-8da4-baaed567406f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:18.921480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-34730635-09c1-48f2-8da4-baaed567406f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:18.929771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-34730635-09c1-48f2-8da4-baaed567406f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082083 Jul 28 03:54:18.930336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1031/1435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:18 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:19.252664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-326efbfb-91d5-4551-a2eb-eaeb5652882e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:19.253344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-326efbfb-91d5-4551-a2eb-eaeb5652882e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:19.259152 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-326efbfb-91d5-4551-a2eb-eaeb5652882e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:19.259596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-326efbfb-91d5-4551-a2eb-eaeb5652882e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:19.260394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-326efbfb-91d5-4551-a2eb-eaeb5652882e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:19.261000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-326efbfb-91d5-4551-a2eb-eaeb5652882e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:19.320200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-326efbfb-91d5-4551-a2eb-eaeb5652882e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:19.327766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-326efbfb-91d5-4551-a2eb-eaeb5652882e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078781 Jul 28 03:54:19.328324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1032/1436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:19 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:19.946761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bd8cfb5a-e44c-4389-8e65-79ae6eae83c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:19.947442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bd8cfb5a-e44c-4389-8e65-79ae6eae83c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:19.953145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bd8cfb5a-e44c-4389-8e65-79ae6eae83c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:19.953591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bd8cfb5a-e44c-4389-8e65-79ae6eae83c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:19.954347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bd8cfb5a-e44c-4389-8e65-79ae6eae83c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:19.954774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bd8cfb5a-e44c-4389-8e65-79ae6eae83c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:20.014033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bd8cfb5a-e44c-4389-8e65-79ae6eae83c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:20.022456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bd8cfb5a-e44c-4389-8e65-79ae6eae83c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079368 Jul 28 03:54:20.023004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1033/1437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:19 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:20.344281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-04c448f6-08d6-497a-a2bc-1801f0461c64 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:20.344931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-04c448f6-08d6-497a-a2bc-1801f0461c64 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:20.351060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04c448f6-08d6-497a-a2bc-1801f0461c64 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:20.351505 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04c448f6-08d6-497a-a2bc-1801f0461c64 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:20.352300 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04c448f6-08d6-497a-a2bc-1801f0461c64 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:20.352734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04c448f6-08d6-497a-a2bc-1801f0461c64 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:20.412183 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-04c448f6-08d6-497a-a2bc-1801f0461c64 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:20.419822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-04c448f6-08d6-497a-a2bc-1801f0461c64 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079178 Jul 28 03:54:20.420376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1034/1438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:20 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:21.039486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4ad528e7-0c46-4f48-902f-fac7f2ba5e4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:21.040176 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4ad528e7-0c46-4f48-902f-fac7f2ba5e4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:21.045919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ad528e7-0c46-4f48-902f-fac7f2ba5e4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:21.046369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ad528e7-0c46-4f48-902f-fac7f2ba5e4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:21.047129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ad528e7-0c46-4f48-902f-fac7f2ba5e4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:21.047565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ad528e7-0c46-4f48-902f-fac7f2ba5e4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:21.105640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4ad528e7-0c46-4f48-902f-fac7f2ba5e4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:21.113634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4ad528e7-0c46-4f48-902f-fac7f2ba5e4f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.077813 Jul 28 03:54:21.114173 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1035/1439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:21 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:21.436150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3bc3778a-1f7f-48cd-b7c9-5aca3cec41c8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:21.436760 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3bc3778a-1f7f-48cd-b7c9-5aca3cec41c8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:21.443272 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bc3778a-1f7f-48cd-b7c9-5aca3cec41c8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:21.443743 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bc3778a-1f7f-48cd-b7c9-5aca3cec41c8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:21.444506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bc3778a-1f7f-48cd-b7c9-5aca3cec41c8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:21.444940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3bc3778a-1f7f-48cd-b7c9-5aca3cec41c8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:21.503235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3bc3778a-1f7f-48cd-b7c9-5aca3cec41c8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:21.510861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3bc3778a-1f7f-48cd-b7c9-5aca3cec41c8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078354 Jul 28 03:54:21.511413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1036/1440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:21 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:22.130363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cef4a5d5-8780-4364-a739-fc83e5b5957d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:22.130984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cef4a5d5-8780-4364-a739-fc83e5b5957d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:22.136799 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cef4a5d5-8780-4364-a739-fc83e5b5957d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:22.137260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cef4a5d5-8780-4364-a739-fc83e5b5957d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:22.138024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cef4a5d5-8780-4364-a739-fc83e5b5957d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:22.138462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cef4a5d5-8780-4364-a739-fc83e5b5957d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:22.200550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cef4a5d5-8780-4364-a739-fc83e5b5957d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:22.208444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cef4a5d5-8780-4364-a739-fc83e5b5957d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081964 Jul 28 03:54:22.209003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1037/1441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:22 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:22.528193 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b7c9d578-0e66-4eaa-beb0-c388ece6eac9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:22.528812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b7c9d578-0e66-4eaa-beb0-c388ece6eac9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:22.535358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7c9d578-0e66-4eaa-beb0-c388ece6eac9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:22.535821 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7c9d578-0e66-4eaa-beb0-c388ece6eac9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:22.536569 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7c9d578-0e66-4eaa-beb0-c388ece6eac9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:22.536999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7c9d578-0e66-4eaa-beb0-c388ece6eac9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:22.594616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b7c9d578-0e66-4eaa-beb0-c388ece6eac9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:22.603117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b7c9d578-0e66-4eaa-beb0-c388ece6eac9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078560 Jul 28 03:54:22.603661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1038/1442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:22 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:23.225899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-355c68e4-df4b-46ce-8bc4-51683f90afc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:23.226517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-355c68e4-df4b-46ce-8bc4-51683f90afc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:23.232262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-355c68e4-df4b-46ce-8bc4-51683f90afc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:23.232707 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-355c68e4-df4b-46ce-8bc4-51683f90afc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:23.233468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-355c68e4-df4b-46ce-8bc4-51683f90afc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:23.233901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-355c68e4-df4b-46ce-8bc4-51683f90afc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:23.293352 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-355c68e4-df4b-46ce-8bc4-51683f90afc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:23.301242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-355c68e4-df4b-46ce-8bc4-51683f90afc9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.079960 Jul 28 03:54:23.301810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1039/1443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:23 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:23.619883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b6db530d-0544-40ed-9d17-ac32486d7d56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:23.620497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b6db530d-0544-40ed-9d17-ac32486d7d56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:23.626207 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6db530d-0544-40ed-9d17-ac32486d7d56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:23.626656 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6db530d-0544-40ed-9d17-ac32486d7d56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:23.627420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6db530d-0544-40ed-9d17-ac32486d7d56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:23.629306 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6db530d-0544-40ed-9d17-ac32486d7d56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:23.685968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b6db530d-0544-40ed-9d17-ac32486d7d56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:23.694125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b6db530d-0544-40ed-9d17-ac32486d7d56 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077864 Jul 28 03:54:23.694690 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1040/1444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:23 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:24.318443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-71b08b03-16b4-4f2d-bb0e-d3255dcb6452 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:24.319121 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-71b08b03-16b4-4f2d-bb0e-d3255dcb6452 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:24.324849 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71b08b03-16b4-4f2d-bb0e-d3255dcb6452 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:24.325297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71b08b03-16b4-4f2d-bb0e-d3255dcb6452 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:24.326064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71b08b03-16b4-4f2d-bb0e-d3255dcb6452 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:24.326497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71b08b03-16b4-4f2d-bb0e-d3255dcb6452 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:24.386835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-71b08b03-16b4-4f2d-bb0e-d3255dcb6452 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:24.394676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-71b08b03-16b4-4f2d-bb0e-d3255dcb6452 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.080709 Jul 28 03:54:24.395229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1041/1445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:24 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:24.710347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-95ca7d27-77fb-4c92-b35a-42c562127d5e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:24.710962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-95ca7d27-77fb-4c92-b35a-42c562127d5e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:24.716899 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-95ca7d27-77fb-4c92-b35a-42c562127d5e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:24.717353 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-95ca7d27-77fb-4c92-b35a-42c562127d5e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:24.718164 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-95ca7d27-77fb-4c92-b35a-42c562127d5e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:24.718625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-95ca7d27-77fb-4c92-b35a-42c562127d5e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:24.778440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-95ca7d27-77fb-4c92-b35a-42c562127d5e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:24.787037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-95ca7d27-77fb-4c92-b35a-42c562127d5e tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080549 Jul 28 03:54:24.787603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1042/1446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:24 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:25.411905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3a99543c-f210-45da-8c66-201a38d5f1e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:25.412540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3a99543c-f210-45da-8c66-201a38d5f1e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:25.418268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3a99543c-f210-45da-8c66-201a38d5f1e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:25.418724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3a99543c-f210-45da-8c66-201a38d5f1e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:25.419486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3a99543c-f210-45da-8c66-201a38d5f1e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:25.419958 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3a99543c-f210-45da-8c66-201a38d5f1e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:25.482283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3a99543c-f210-45da-8c66-201a38d5f1e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:25.490441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3a99543c-f210-45da-8c66-201a38d5f1e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.082404 Jul 28 03:54:25.490993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1043/1447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:25 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:25.804221 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-716f356e-d682-4866-aead-64ad4cfcde9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:25.804749 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-716f356e-d682-4866-aead-64ad4cfcde9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:25.810548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-716f356e-d682-4866-aead-64ad4cfcde9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:25.810990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-716f356e-d682-4866-aead-64ad4cfcde9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:25.811763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-716f356e-d682-4866-aead-64ad4cfcde9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:25.812194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-716f356e-d682-4866-aead-64ad4cfcde9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:25.871777 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-716f356e-d682-4866-aead-64ad4cfcde9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:25.879585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-716f356e-d682-4866-aead-64ad4cfcde9f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079806 Jul 28 03:54:25.880164 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1044/1448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:25 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:26.507021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-044eb1d4-861d-43a0-ba4c-3dd2906d7104 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:26.507661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-044eb1d4-861d-43a0-ba4c-3dd2906d7104 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:26.513463 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-044eb1d4-861d-43a0-ba4c-3dd2906d7104 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:26.513911 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-044eb1d4-861d-43a0-ba4c-3dd2906d7104 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:26.514663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-044eb1d4-861d-43a0-ba4c-3dd2906d7104 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:26.515090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-044eb1d4-861d-43a0-ba4c-3dd2906d7104 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:26.573930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-044eb1d4-861d-43a0-ba4c-3dd2906d7104 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:26.582228 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-044eb1d4-861d-43a0-ba4c-3dd2906d7104 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078790 Jul 28 03:54:26.582779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1045/1449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:26 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:26.896035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d67f8264-1089-453f-8505-6ef248fb18de tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:26.896639 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d67f8264-1089-453f-8505-6ef248fb18de tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:26.902280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d67f8264-1089-453f-8505-6ef248fb18de tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:26.902720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d67f8264-1089-453f-8505-6ef248fb18de tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:26.903468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d67f8264-1089-453f-8505-6ef248fb18de tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:26.903924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d67f8264-1089-453f-8505-6ef248fb18de tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:26.963148 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d67f8264-1089-453f-8505-6ef248fb18de tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:26.970682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d67f8264-1089-453f-8505-6ef248fb18de tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079282 Jul 28 03:54:26.971231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1046/1450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:26 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:27.598118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fe109dda-43f9-4046-916f-9bb420026ef0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:27.598761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fe109dda-43f9-4046-916f-9bb420026ef0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:27.604792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe109dda-43f9-4046-916f-9bb420026ef0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:27.605269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe109dda-43f9-4046-916f-9bb420026ef0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:27.606027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe109dda-43f9-4046-916f-9bb420026ef0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:27.606459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fe109dda-43f9-4046-916f-9bb420026ef0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:27.664508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fe109dda-43f9-4046-916f-9bb420026ef0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:27.671994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fe109dda-43f9-4046-916f-9bb420026ef0 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.077689 Jul 28 03:54:27.672545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1047/1451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:27 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:27.988398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5eaacfd9-f1d0-4db1-a3dc-8f6646c7cf22 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:27.988922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5eaacfd9-f1d0-4db1-a3dc-8f6646c7cf22 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:27.994785 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5eaacfd9-f1d0-4db1-a3dc-8f6646c7cf22 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:27.995230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5eaacfd9-f1d0-4db1-a3dc-8f6646c7cf22 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:27.996006 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5eaacfd9-f1d0-4db1-a3dc-8f6646c7cf22 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:27.996436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5eaacfd9-f1d0-4db1-a3dc-8f6646c7cf22 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:28.054839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5eaacfd9-f1d0-4db1-a3dc-8f6646c7cf22 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:28.062425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5eaacfd9-f1d0-4db1-a3dc-8f6646c7cf22 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078347 Jul 28 03:54:28.062964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1048/1452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:27 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:28.688547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f58c1c79-d46e-41b9-85d9-26b346600c84 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:28.689193 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f58c1c79-d46e-41b9-85d9-26b346600c84 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:28.695274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f58c1c79-d46e-41b9-85d9-26b346600c84 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:28.695754 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f58c1c79-d46e-41b9-85d9-26b346600c84 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:28.696532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f58c1c79-d46e-41b9-85d9-26b346600c84 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:28.696968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f58c1c79-d46e-41b9-85d9-26b346600c84 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:28.759016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f58c1c79-d46e-41b9-85d9-26b346600c84 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:28.766691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f58c1c79-d46e-41b9-85d9-26b346600c84 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081892 Jul 28 03:54:28.767252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1049/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:28 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:29.080382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e51cd402-b8bd-4488-8119-9a4f6933a176 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:29.081546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e51cd402-b8bd-4488-8119-9a4f6933a176 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:29.087239 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e51cd402-b8bd-4488-8119-9a4f6933a176 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:29.087693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e51cd402-b8bd-4488-8119-9a4f6933a176 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:29.088494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e51cd402-b8bd-4488-8119-9a4f6933a176 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:29.088926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e51cd402-b8bd-4488-8119-9a4f6933a176 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:29.147930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e51cd402-b8bd-4488-8119-9a4f6933a176 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:29.155506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e51cd402-b8bd-4488-8119-9a4f6933a176 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078798 Jul 28 03:54:29.156095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1050/1454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:29 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:29.782956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-54ca477a-805b-48b0-aa91-850df1961049 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:29.783648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-54ca477a-805b-48b0-aa91-850df1961049 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:29.790335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54ca477a-805b-48b0-aa91-850df1961049 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:29.790779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54ca477a-805b-48b0-aa91-850df1961049 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:29.791541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54ca477a-805b-48b0-aa91-850df1961049 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:29.792001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54ca477a-805b-48b0-aa91-850df1961049 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:29.850425 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-54ca477a-805b-48b0-aa91-850df1961049 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:29.858137 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-54ca477a-805b-48b0-aa91-850df1961049 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078825 Jul 28 03:54:29.858684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1051/1455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:29 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:30.171888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e8cbf0d9-8488-42aa-a572-655c3eca67b4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:30.172488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e8cbf0d9-8488-42aa-a572-655c3eca67b4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:30.178614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8cbf0d9-8488-42aa-a572-655c3eca67b4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:30.179060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8cbf0d9-8488-42aa-a572-655c3eca67b4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:30.179852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8cbf0d9-8488-42aa-a572-655c3eca67b4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:30.180282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8cbf0d9-8488-42aa-a572-655c3eca67b4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:30.239347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e8cbf0d9-8488-42aa-a572-655c3eca67b4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:30.246834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e8cbf0d9-8488-42aa-a572-655c3eca67b4 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078563 Jul 28 03:54:30.247382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1052/1456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:30 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:30.875117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-740f19c4-3ab2-4a39-a29a-14836d2b193c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:30.875777 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-740f19c4-3ab2-4a39-a29a-14836d2b193c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:30.882487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-740f19c4-3ab2-4a39-a29a-14836d2b193c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:30.882936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-740f19c4-3ab2-4a39-a29a-14836d2b193c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:30.883702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-740f19c4-3ab2-4a39-a29a-14836d2b193c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:30.884160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-740f19c4-3ab2-4a39-a29a-14836d2b193c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:30.942925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-740f19c4-3ab2-4a39-a29a-14836d2b193c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:30.950531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-740f19c4-3ab2-4a39-a29a-14836d2b193c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078998 Jul 28 03:54:30.951087 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1053/1457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:30 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:31.265290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4b48dc8f-ee8d-475f-973f-56726d99b225 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:31.266043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4b48dc8f-ee8d-475f-973f-56726d99b225 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:31.271962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b48dc8f-ee8d-475f-973f-56726d99b225 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:31.272424 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b48dc8f-ee8d-475f-973f-56726d99b225 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:31.273186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b48dc8f-ee8d-475f-973f-56726d99b225 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:31.273655 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4b48dc8f-ee8d-475f-973f-56726d99b225 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:31.331998 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4b48dc8f-ee8d-475f-973f-56726d99b225 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:31.340008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4b48dc8f-ee8d-475f-973f-56726d99b225 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080220 Jul 28 03:54:31.340592 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1054/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:31 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:31.967202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-82778fac-fa20-4571-8d39-3cb61a3b00cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:31.967916 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-82778fac-fa20-4571-8d39-3cb61a3b00cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:31.973622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82778fac-fa20-4571-8d39-3cb61a3b00cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:31.974071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82778fac-fa20-4571-8d39-3cb61a3b00cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:31.974828 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82778fac-fa20-4571-8d39-3cb61a3b00cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:31.975266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-82778fac-fa20-4571-8d39-3cb61a3b00cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:32.037130 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-82778fac-fa20-4571-8d39-3cb61a3b00cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:32.044809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-82778fac-fa20-4571-8d39-3cb61a3b00cb tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081262 Jul 28 03:54:32.045357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1055/1459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:31 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:32.357617 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4c8e0de9-7543-4298-abde-2827703012c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:32.358260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4c8e0de9-7543-4298-abde-2827703012c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:32.364750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c8e0de9-7543-4298-abde-2827703012c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:32.365203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c8e0de9-7543-4298-abde-2827703012c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:32.365969 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c8e0de9-7543-4298-abde-2827703012c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:32.366404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4c8e0de9-7543-4298-abde-2827703012c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:32.425354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4c8e0de9-7543-4298-abde-2827703012c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:32.432977 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4c8e0de9-7543-4298-abde-2827703012c6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079100 Jul 28 03:54:32.433526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1056/1460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:32 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:33.062086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-68bb5d00-3e5a-4963-8aa5-ca0f037b9d7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:33.062745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-68bb5d00-3e5a-4963-8aa5-ca0f037b9d7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:33.068644 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68bb5d00-3e5a-4963-8aa5-ca0f037b9d7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:33.069093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68bb5d00-3e5a-4963-8aa5-ca0f037b9d7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:33.069852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68bb5d00-3e5a-4963-8aa5-ca0f037b9d7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:33.070289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68bb5d00-3e5a-4963-8aa5-ca0f037b9d7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:33.128854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-68bb5d00-3e5a-4963-8aa5-ca0f037b9d7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:33.136445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-68bb5d00-3e5a-4963-8aa5-ca0f037b9d7d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078079 Jul 28 03:54:33.137033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1057/1461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:33 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:33.450212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-29cbc152-9ad3-4545-ab62-6b08b3e4ec07 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:33.450825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-29cbc152-9ad3-4545-ab62-6b08b3e4ec07 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:33.457222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29cbc152-9ad3-4545-ab62-6b08b3e4ec07 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:33.457669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29cbc152-9ad3-4545-ab62-6b08b3e4ec07 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:33.458434 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29cbc152-9ad3-4545-ab62-6b08b3e4ec07 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:33.458863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-29cbc152-9ad3-4545-ab62-6b08b3e4ec07 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:33.517827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-29cbc152-9ad3-4545-ab62-6b08b3e4ec07 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:33.526191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-29cbc152-9ad3-4545-ab62-6b08b3e4ec07 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079602 Jul 28 03:54:33.526740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1058/1462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:33 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:34.153451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7319e783-f0c2-457b-bff5-f484dfb75ddd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:34.154056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7319e783-f0c2-457b-bff5-f484dfb75ddd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:34.160422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7319e783-f0c2-457b-bff5-f484dfb75ddd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:34.160863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7319e783-f0c2-457b-bff5-f484dfb75ddd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:34.161615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7319e783-f0c2-457b-bff5-f484dfb75ddd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:34.162047 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7319e783-f0c2-457b-bff5-f484dfb75ddd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:34.223054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7319e783-f0c2-457b-bff5-f484dfb75ddd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:34.230865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7319e783-f0c2-457b-bff5-f484dfb75ddd tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081018 Jul 28 03:54:34.231404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1059/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:34 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:34.544408 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a5b3c02d-ce81-4d58-bcf9-75420f56c52f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:34.544949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a5b3c02d-ce81-4d58-bcf9-75420f56c52f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:34.550759 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a5b3c02d-ce81-4d58-bcf9-75420f56c52f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:34.551206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a5b3c02d-ce81-4d58-bcf9-75420f56c52f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:34.551983 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a5b3c02d-ce81-4d58-bcf9-75420f56c52f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:34.552411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a5b3c02d-ce81-4d58-bcf9-75420f56c52f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:34.611030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a5b3c02d-ce81-4d58-bcf9-75420f56c52f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:34.618836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a5b3c02d-ce81-4d58-bcf9-75420f56c52f tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.080061 Jul 28 03:54:34.619385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1060/1464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:34 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:35.248640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-47d50433-105d-44f0-9b32-e0f037bbdfd4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:35.249301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-47d50433-105d-44f0-9b32-e0f037bbdfd4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:35.255682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47d50433-105d-44f0-9b32-e0f037bbdfd4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:35.256160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47d50433-105d-44f0-9b32-e0f037bbdfd4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:35.256926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47d50433-105d-44f0-9b32-e0f037bbdfd4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:35.257364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-47d50433-105d-44f0-9b32-e0f037bbdfd4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:35.323170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-47d50433-105d-44f0-9b32-e0f037bbdfd4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:35.331208 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-47d50433-105d-44f0-9b32-e0f037bbdfd4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.085843 Jul 28 03:54:35.331822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1061/1465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:35 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:35.635860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0fa4b59c-b3c1-4801-baee-917173b582c2 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:35.636473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0fa4b59c-b3c1-4801-baee-917173b582c2 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:35.642232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fa4b59c-b3c1-4801-baee-917173b582c2 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:35.642676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fa4b59c-b3c1-4801-baee-917173b582c2 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:35.643583 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fa4b59c-b3c1-4801-baee-917173b582c2 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:35.644062 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0fa4b59c-b3c1-4801-baee-917173b582c2 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:35.702438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0fa4b59c-b3c1-4801-baee-917173b582c2 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:35.710310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0fa4b59c-b3c1-4801-baee-917173b582c2 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078026 Jul 28 03:54:35.710872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1062/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:35 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:36.348305 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e76f87d7-be30-4d6c-877b-80e7081c42b6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:36.348939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e76f87d7-be30-4d6c-877b-80e7081c42b6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:36.354823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e76f87d7-be30-4d6c-877b-80e7081c42b6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:36.355261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e76f87d7-be30-4d6c-877b-80e7081c42b6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:36.356039 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e76f87d7-be30-4d6c-877b-80e7081c42b6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:36.356469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e76f87d7-be30-4d6c-877b-80e7081c42b6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:36.414564 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e76f87d7-be30-4d6c-877b-80e7081c42b6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:36.422091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e76f87d7-be30-4d6c-877b-80e7081c42b6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078168 Jul 28 03:54:36.422637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1063/1467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:36 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:36.727679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6d0c80be-d58a-4add-8458-91cbcec56e44 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:36.728236 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6d0c80be-d58a-4add-8458-91cbcec56e44 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:36.733874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6d0c80be-d58a-4add-8458-91cbcec56e44 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:36.734318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6d0c80be-d58a-4add-8458-91cbcec56e44 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:36.735068 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6d0c80be-d58a-4add-8458-91cbcec56e44 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:36.735494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6d0c80be-d58a-4add-8458-91cbcec56e44 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:36.795309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6d0c80be-d58a-4add-8458-91cbcec56e44 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:36.803075 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6d0c80be-d58a-4add-8458-91cbcec56e44 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.079214 Jul 28 03:54:36.803629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1064/1468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:36 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:37.437688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1d6b8da7-ef51-4e81-a70c-88ea07cac854 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:37.438317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1d6b8da7-ef51-4e81-a70c-88ea07cac854 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:37.444733 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1d6b8da7-ef51-4e81-a70c-88ea07cac854 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:37.445182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1d6b8da7-ef51-4e81-a70c-88ea07cac854 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:37.445981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1d6b8da7-ef51-4e81-a70c-88ea07cac854 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:37.446418 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1d6b8da7-ef51-4e81-a70c-88ea07cac854 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:37.504392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1d6b8da7-ef51-4e81-a70c-88ea07cac854 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:37.512439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1d6b8da7-ef51-4e81-a70c-88ea07cac854 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078470 Jul 28 03:54:37.512990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1065/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:37 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:37.820296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2ef7fe64-5e85-488a-b5a4-b40ce29d8bf9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:37.820827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2ef7fe64-5e85-488a-b5a4-b40ce29d8bf9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:37.826474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ef7fe64-5e85-488a-b5a4-b40ce29d8bf9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:37.826919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ef7fe64-5e85-488a-b5a4-b40ce29d8bf9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:37.827665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ef7fe64-5e85-488a-b5a4-b40ce29d8bf9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:37.828117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ef7fe64-5e85-488a-b5a4-b40ce29d8bf9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:37.886479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2ef7fe64-5e85-488a-b5a4-b40ce29d8bf9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:37.894502 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2ef7fe64-5e85-488a-b5a4-b40ce29d8bf9 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078633 Jul 28 03:54:37.895091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1066/1470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:37 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:38.529082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7a3839fe-cd35-4b38-99bc-aafb394825d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:38.529720 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7a3839fe-cd35-4b38-99bc-aafb394825d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:38.536114 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a3839fe-cd35-4b38-99bc-aafb394825d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:38.536565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a3839fe-cd35-4b38-99bc-aafb394825d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:38.537327 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a3839fe-cd35-4b38-99bc-aafb394825d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:38.537757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a3839fe-cd35-4b38-99bc-aafb394825d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:38.599241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7a3839fe-cd35-4b38-99bc-aafb394825d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:38.607369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7a3839fe-cd35-4b38-99bc-aafb394825d3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.081986 Jul 28 03:54:38.607951 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1067/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:38 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:38.910833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b5b8f3cf-8c8c-429f-ba69-d1af05982675 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:38.911451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b5b8f3cf-8c8c-429f-ba69-d1af05982675 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:38.917332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b5b8f3cf-8c8c-429f-ba69-d1af05982675 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:38.917791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b5b8f3cf-8c8c-429f-ba69-d1af05982675 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:38.918563 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b5b8f3cf-8c8c-429f-ba69-d1af05982675 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:38.918999 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b5b8f3cf-8c8c-429f-ba69-d1af05982675 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:38.978321 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b5b8f3cf-8c8c-429f-ba69-d1af05982675 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:38.986095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b5b8f3cf-8c8c-429f-ba69-d1af05982675 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.078958 Jul 28 03:54:38.987144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1068/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:38 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:39.624594 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c68ee6d6-f0c8-459e-b0d1-b6cbd35847c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:39.625311 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c68ee6d6-f0c8-459e-b0d1-b6cbd35847c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:39.631422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c68ee6d6-f0c8-459e-b0d1-b6cbd35847c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:39.631909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c68ee6d6-f0c8-459e-b0d1-b6cbd35847c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:39.632682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c68ee6d6-f0c8-459e-b0d1-b6cbd35847c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:39.633116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c68ee6d6-f0c8-459e-b0d1-b6cbd35847c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:39.691472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c68ee6d6-f0c8-459e-b0d1-b6cbd35847c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:39.699187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c68ee6d6-f0c8-459e-b0d1-b6cbd35847c8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.078528 Jul 28 03:54:39.699750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1069/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:39 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:40.002865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-10d82a95-4e25-433e-a6f9-189c9e92e172 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.003402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-10d82a95-4e25-433e-a6f9-189c9e92e172 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:40.009294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10d82a95-4e25-433e-a6f9-189c9e92e172 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:40.009742 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10d82a95-4e25-433e-a6f9-189c9e92e172 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:40.010504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10d82a95-4e25-433e-a6f9-189c9e92e172 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:40.010936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-10d82a95-4e25-433e-a6f9-189c9e92e172 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:40.069200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-10d82a95-4e25-433e-a6f9-189c9e92e172 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:40.076766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-10d82a95-4e25-433e-a6f9-189c9e92e172 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.077657 Jul 28 03:54:40.077313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1070/1474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:39 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:40.715242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7a75669b-d913-498d-bb14-f6316d5d5707 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.715923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7a75669b-d913-498d-bb14-f6316d5d5707 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:40.721782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a75669b-d913-498d-bb14-f6316d5d5707 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:40.722227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a75669b-d913-498d-bb14-f6316d5d5707 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:40.722993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a75669b-d913-498d-bb14-f6316d5d5707 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:40.723427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7a75669b-d913-498d-bb14-f6316d5d5707 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:40.781641 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7a75669b-d913-498d-bb14-f6316d5d5707 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:40.789491 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7a75669b-d913-498d-bb14-f6316d5d5707 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 200 len: 1368 microversion: 2.1 time: 0.077876 Jul 28 03:54:40.790038 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1071/1475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:40 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 1368 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:41.093943 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0d3a2211-4d1f-409b-b5e2-c79cc04a6741 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:41.094558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0d3a2211-4d1f-409b-b5e2-c79cc04a6741 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:41.101094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d3a2211-4d1f-409b-b5e2-c79cc04a6741 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:41.101548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d3a2211-4d1f-409b-b5e2-c79cc04a6741 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:41.102323 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d3a2211-4d1f-409b-b5e2-c79cc04a6741 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:41.102759 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0d3a2211-4d1f-409b-b5e2-c79cc04a6741 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:41.162256 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0d3a2211-4d1f-409b-b5e2-c79cc04a6741 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:41.177823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0d3a2211-4d1f-409b-b5e2-c79cc04a6741 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.087622 Jul 28 03:54:41.178397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1072/1476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:41 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:41.806110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5651a151-e839-4965-a9e8-ba18580598f8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:41.806790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5651a151-e839-4965-a9e8-ba18580598f8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:41.812593 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5651a151-e839-4965-a9e8-ba18580598f8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:41.813040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5651a151-e839-4965-a9e8-ba18580598f8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:41.813800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5651a151-e839-4965-a9e8-ba18580598f8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:41.814234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5651a151-e839-4965-a9e8-ba18580598f8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:41.827692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-5651a151-e839-4965-a9e8-ba18580598f8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] HTTP exception thrown: Instance c0eb74a9-c89c-4863-9431-4de9be74c41c could not be found. Jul 28 03:54:41.828298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5651a151-e839-4965-a9e8-ba18580598f8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Returning 404 to user: Instance c0eb74a9-c89c-4863-9431-4de9be74c41c could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:54:41.829095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5651a151-e839-4965-a9e8-ba18580598f8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 404 len: 111 microversion: 2.1 time: 0.026719 Jul 28 03:54:41.829594 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1073/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:41 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:54:41.837968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-598e8099-da06-408a-aa67-75ec6070c5b1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '.version_select at 0x7f68068deca0>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:41.857748 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-598e8099-da06-408a-aa67-75ec6070c5b1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-889918020" status: 202 len: 0 microversion: 2.1 time: 0.022899 Jul 28 03:54:41.858283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1074/1478] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Jul 28 03:54:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-889918020 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:54:42.306247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-84043a99-c836-4ea5-b2db-48b8676a39c7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:42.306847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-84043a99-c836-4ea5-b2db-48b8676a39c7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:42.312521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84043a99-c836-4ea5-b2db-48b8676a39c7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:42.312966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84043a99-c836-4ea5-b2db-48b8676a39c7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:42.313719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84043a99-c836-4ea5-b2db-48b8676a39c7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:42.314143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84043a99-c836-4ea5-b2db-48b8676a39c7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:42.374867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-84043a99-c836-4ea5-b2db-48b8676a39c7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:42.383110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-84043a99-c836-4ea5-b2db-48b8676a39c7 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.191831 Jul 28 03:54:42.390933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1075/1479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:42 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:42.627685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8f61e014-c67e-4409-8876-b39cd9eebc89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'create', calling method: .version_select at 0x7f68068de9d0>, body: {"keypair": {"name": "tempest-keypair-100883603"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:42.644979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-8f61e014-c67e-4409-8876-b39cd9eebc89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:54:42.648710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-8f61e014-c67e-4409-8876-b39cd9eebc89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for user faf7da464d4c44db918dd6c5076846e9 and project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:54:42.860961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-8f61e014-c67e-4409-8876-b39cd9eebc89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:54:42.865193 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-8f61e014-c67e-4409-8876-b39cd9eebc89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for user faf7da464d4c44db918dd6c5076846e9 and project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:54:42.878033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8f61e014-c67e-4409-8876-b39cd9eebc89 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.253667 Jul 28 03:54:42.878538 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1076/1480] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jul 28 03:54:42 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:43.399833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d4f872eb-0d6f-47f9-9098-dc08707857e8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:43.400356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d4f872eb-0d6f-47f9-9098-dc08707857e8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:43.406048 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d4f872eb-0d6f-47f9-9098-dc08707857e8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:43.406501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d4f872eb-0d6f-47f9-9098-dc08707857e8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:43.407267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d4f872eb-0d6f-47f9-9098-dc08707857e8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:43.407701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d4f872eb-0d6f-47f9-9098-dc08707857e8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:43.468741 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d4f872eb-0d6f-47f9-9098-dc08707857e8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:43.477394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d4f872eb-0d6f-47f9-9098-dc08707857e8 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.081360 Jul 28 03:54:43.477967 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1077/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:43 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:44.100387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1583123105", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4735ad5f-8ca5-4c8f-80b1-984a4e72f7a0"}], "security_groups": [{"name": "tempest-securitygroup--863037143"}], "key_name": "tempest-keypair-100883603", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:44.194539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] validate_networks() for [('4735ad5f-8ca5-4c8f-80b1-984a4e72f7a0', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 03:54:44.593873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:54:44.594299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:54:44.594780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:54:44.595219 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:54:44.595632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:54:44.605033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:44.605478 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:44.606270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:44.606710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:44.623010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 03:54:44.626835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Getting quotas for user faf7da464d4c44db918dd6c5076846e9 and project e20265dc285042d5ab0d2e9237fe9fdf. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 03:54:44.637847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 03:54:44.640140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 03:54:44.685945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a4079eeb-c41f-4ae6-8478-658827375e8d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.590210 Jul 28 03:54:44.686580 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1078/1482] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 03:54:44 2021] POST /compute/v2.1/servers => generated 401 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:54:44.691739 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-078ecae9-f753-4e62-b973-fb49b54a7036 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:44.692426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-078ecae9-f753-4e62-b973-fb49b54a7036 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:44.698298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-078ecae9-f753-4e62-b973-fb49b54a7036 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:44.698728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-078ecae9-f753-4e62-b973-fb49b54a7036 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:44.699526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-078ecae9-f753-4e62-b973-fb49b54a7036 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:44.699996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-078ecae9-f753-4e62-b973-fb49b54a7036 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:44.762089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-078ecae9-f753-4e62-b973-fb49b54a7036 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:44.770534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-078ecae9-f753-4e62-b973-fb49b54a7036 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1350 microversion: 2.1 time: 0.082930 Jul 28 03:54:44.771093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1079/1483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:44 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:44.775291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b95fa016-cc41-41de-8d75-c043ae381b53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:44.775943 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b95fa016-cc41-41de-8d75-c043ae381b53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:44.826940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b95fa016-cc41-41de-8d75-c043ae381b53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:44.834502 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b95fa016-cc41-41de-8d75-c043ae381b53 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1237 microversion: 2.1 time: 0.062444 Jul 28 03:54:44.835050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1080/1484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:44 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1237 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:45.788670 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:45.789763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:45.796763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:45.797213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:45.797976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:45.798408 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:45.830072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:45.831192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:45.831847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lazy-loading 'fault' on Instance uuid 6defc507-3456-460c-94f0-1d954af7997d {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:54:45.880322 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6d5c2460744df9ba96e3d336e4747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55fad6251ff244ea9f24d160e444628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:45.889326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-24ed4dd2-7a8e-40d6-978d-715cea19a5f6 tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 200 len: 1444 microversion: 2.1 time: 0.105908 Jul 28 03:54:45.890570 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1081/1485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:45 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:45.896542 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9a5b89f3-05c9-4bdb-83e8-a22cc9184c4d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:45.897350 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9a5b89f3-05c9-4bdb-83e8-a22cc9184c4d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:45.905137 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a5b89f3-05c9-4bdb-83e8-a22cc9184c4d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:45.905790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a5b89f3-05c9-4bdb-83e8-a22cc9184c4d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:45.907388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a5b89f3-05c9-4bdb-83e8-a22cc9184c4d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:45.909364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9a5b89f3-05c9-4bdb-83e8-a22cc9184c4d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:45.976398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9a5b89f3-05c9-4bdb-83e8-a22cc9184c4d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:45.983866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9a5b89f3-05c9-4bdb-83e8-a22cc9184c4d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1295 microversion: 2.1 time: 0.092076 Jul 28 03:54:45.984421 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1082/1486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:45 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:46.907488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eee1a0d1-bbae-408c-86ba-5ce9444a1f8c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:46.908965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eee1a0d1-bbae-408c-86ba-5ce9444a1f8c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] [instance: 6defc507-3456-460c-94f0-1d954af7997d] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:46.914765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eee1a0d1-bbae-408c-86ba-5ce9444a1f8c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:46.915403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eee1a0d1-bbae-408c-86ba-5ce9444a1f8c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:46.916383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eee1a0d1-bbae-408c-86ba-5ce9444a1f8c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:46.916816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eee1a0d1-bbae-408c-86ba-5ce9444a1f8c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:46.930190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-eee1a0d1-bbae-408c-86ba-5ce9444a1f8c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] HTTP exception thrown: Instance 6defc507-3456-460c-94f0-1d954af7997d could not be found. Jul 28 03:54:46.930776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eee1a0d1-bbae-408c-86ba-5ce9444a1f8c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] Returning 404 to user: Instance 6defc507-3456-460c-94f0-1d954af7997d could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:54:46.931612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eee1a0d1-bbae-408c-86ba-5ce9444a1f8c tempest-VolumesSnapshotTestJSON-1701589923 tempest-VolumesSnapshotTestJSON-1701589923-project] 10.222.0.16 "GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d" status: 404 len: 111 microversion: 2.1 time: 0.027793 Jul 28 03:54:46.932156 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1083/1487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:46 2021] GET /compute/v2.1/servers/6defc507-3456-460c-94f0-1d954af7997d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:54:47.005416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e67e9824-0afa-4798-90c8-fdb48c65796b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:47.006323 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e67e9824-0afa-4798-90c8-fdb48c65796b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:47.021115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e67e9824-0afa-4798-90c8-fdb48c65796b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:47.021565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e67e9824-0afa-4798-90c8-fdb48c65796b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:47.022388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e67e9824-0afa-4798-90c8-fdb48c65796b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:47.023189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e67e9824-0afa-4798-90c8-fdb48c65796b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:47.193956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e67e9824-0afa-4798-90c8-fdb48c65796b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:47.207215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e67e9824-0afa-4798-90c8-fdb48c65796b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1362 microversion: 2.1 time: 0.208473 Jul 28 03:54:47.215940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1084/1488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:46 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:47.320072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-d1a4e6f1-0742-4199-b4c7-366b2df46452 req-45b71f10-b73d-46a9-bc3f-baefc49639f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b184416a-b6b8-447e-a592-9030cabfa404", "tag": "2226f438-8e90-4b31-a8d7-9b71702e0d00"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:47.322064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:54:47.322064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:54:47.329007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-d1a4e6f1-0742-4199-b4c7-366b2df46452 req-45b71f10-b73d-46a9-bc3f-baefc49639f5 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:47.329445 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-d1a4e6f1-0742-4199-b4c7-366b2df46452 req-45b71f10-b73d-46a9-bc3f-baefc49639f5 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:47.342366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-d1a4e6f1-0742-4199-b4c7-366b2df46452 req-45b71f10-b73d-46a9-bc3f-baefc49639f5 service nova] Creating event network-changed:2226f438-8e90-4b31-a8d7-9b71702e0d00 for instance b184416a-b6b8-447e-a592-9030cabfa404 on hv-cinder-73306 Jul 28 03:54:47.347631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-d1a4e6f1-0742-4199-b4c7-366b2df46452 req-45b71f10-b73d-46a9-bc3f-baefc49639f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135938 Jul 28 03:54:47.348423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1085/1489] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:54:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:48.226023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0af9ee11-256e-4da6-9b89-46ae7d22dbe5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:48.226747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0af9ee11-256e-4da6-9b89-46ae7d22dbe5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:48.232717 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0af9ee11-256e-4da6-9b89-46ae7d22dbe5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:48.233163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0af9ee11-256e-4da6-9b89-46ae7d22dbe5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:48.233922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0af9ee11-256e-4da6-9b89-46ae7d22dbe5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:48.234356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0af9ee11-256e-4da6-9b89-46ae7d22dbe5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:48.355117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0af9ee11-256e-4da6-9b89-46ae7d22dbe5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:48.362975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0af9ee11-256e-4da6-9b89-46ae7d22dbe5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1362 microversion: 2.1 time: 0.141291 Jul 28 03:54:48.363523 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1086/1490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:48 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1362 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:49.379490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-822aeeef-706f-41bd-b386-2b6a0ee67d04 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:49.380162 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-822aeeef-706f-41bd-b386-2b6a0ee67d04 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:49.386159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-822aeeef-706f-41bd-b386-2b6a0ee67d04 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:49.386620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-822aeeef-706f-41bd-b386-2b6a0ee67d04 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:49.387383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-822aeeef-706f-41bd-b386-2b6a0ee67d04 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:49.387852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-822aeeef-706f-41bd-b386-2b6a0ee67d04 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:49.510790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-822aeeef-706f-41bd-b386-2b6a0ee67d04 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:49.518361 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-822aeeef-706f-41bd-b386-2b6a0ee67d04 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1362 microversion: 2.1 time: 0.142923 Jul 28 03:54:49.518923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1087/1491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:49 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:50.535763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-38f0c33b-18dd-4d5a-8f2a-b250fc91fd2e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:50.536428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-38f0c33b-18dd-4d5a-8f2a-b250fc91fd2e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:50.542519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38f0c33b-18dd-4d5a-8f2a-b250fc91fd2e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:50.542996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38f0c33b-18dd-4d5a-8f2a-b250fc91fd2e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:50.543820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38f0c33b-18dd-4d5a-8f2a-b250fc91fd2e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:50.544261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38f0c33b-18dd-4d5a-8f2a-b250fc91fd2e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:50.667329 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-38f0c33b-18dd-4d5a-8f2a-b250fc91fd2e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:50.674565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-38f0c33b-18dd-4d5a-8f2a-b250fc91fd2e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1362 microversion: 2.1 time: 0.143224 Jul 28 03:54:50.675147 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1088/1492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:50 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:51.689946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6fec4c3d-c383-4d8a-b544-d2c93e81803e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:51.690669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6fec4c3d-c383-4d8a-b544-d2c93e81803e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:51.697116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6fec4c3d-c383-4d8a-b544-d2c93e81803e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:51.697116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6fec4c3d-c383-4d8a-b544-d2c93e81803e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:51.698804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6fec4c3d-c383-4d8a-b544-d2c93e81803e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:51.699245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6fec4c3d-c383-4d8a-b544-d2c93e81803e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:51.817764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6fec4c3d-c383-4d8a-b544-d2c93e81803e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:51.824827 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6fec4c3d-c383-4d8a-b544-d2c93e81803e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1362 microversion: 2.1 time: 0.138556 Jul 28 03:54:51.825380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1089/1493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:51 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:52.212883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-d400972a-4d58-4aa7-8da2-5d7910a736ce req-43cf4ce4-9d19-4f58-ac43-8240fe012d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b184416a-b6b8-447e-a592-9030cabfa404", "name": "network-vif-plugged", "status": "completed", "tag": "2226f438-8e90-4b31-a8d7-9b71702e0d00"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:52.214543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:54:52.214543 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:54:52.221963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-d400972a-4d58-4aa7-8da2-5d7910a736ce req-43cf4ce4-9d19-4f58-ac43-8240fe012d65 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:52.222405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-d400972a-4d58-4aa7-8da2-5d7910a736ce req-43cf4ce4-9d19-4f58-ac43-8240fe012d65 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:52.233394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-d400972a-4d58-4aa7-8da2-5d7910a736ce req-43cf4ce4-9d19-4f58-ac43-8240fe012d65 service nova] Creating event network-vif-plugged:2226f438-8e90-4b31-a8d7-9b71702e0d00 for instance b184416a-b6b8-447e-a592-9030cabfa404 on hv-cinder-73306 Jul 28 03:54:52.238305 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-d400972a-4d58-4aa7-8da2-5d7910a736ce req-43cf4ce4-9d19-4f58-ac43-8240fe012d65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089425 Jul 28 03:54:52.238869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1090/1494] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:54:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:54:52.842325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8e0d27b9-69c3-4be1-b297-93d3e430cb62 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:52.843030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8e0d27b9-69c3-4be1-b297-93d3e430cb62 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:52.849932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e0d27b9-69c3-4be1-b297-93d3e430cb62 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:52.850387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e0d27b9-69c3-4be1-b297-93d3e430cb62 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:52.851409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e0d27b9-69c3-4be1-b297-93d3e430cb62 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:52.851885 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e0d27b9-69c3-4be1-b297-93d3e430cb62 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:52.973862 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8e0d27b9-69c3-4be1-b297-93d3e430cb62 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:52.981243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8e0d27b9-69c3-4be1-b297-93d3e430cb62 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1362 microversion: 2.1 time: 0.142917 Jul 28 03:54:52.981794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1091/1495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:52 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:53.998093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2077942a-4041-42c5-b5be-5c5805148dbc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:53.998725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2077942a-4041-42c5-b5be-5c5805148dbc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:54.005035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2077942a-4041-42c5-b5be-5c5805148dbc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:54.005533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2077942a-4041-42c5-b5be-5c5805148dbc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:54.006245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2077942a-4041-42c5-b5be-5c5805148dbc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:54.006676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2077942a-4041-42c5-b5be-5c5805148dbc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:54.123651 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2077942a-4041-42c5-b5be-5c5805148dbc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:54.131723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2077942a-4041-42c5-b5be-5c5805148dbc tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1547 microversion: 2.1 time: 0.137308 Jul 28 03:54:54.132276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1092/1496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:54:53 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1547 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:54.147272 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d95c6b40-b692-43d8-bb6f-883717538a1c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:54.147824 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d95c6b40-b692-43d8-bb6f-883717538a1c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:54.153548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d95c6b40-b692-43d8-bb6f-883717538a1c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:54.154000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d95c6b40-b692-43d8-bb6f-883717538a1c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:54.154763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d95c6b40-b692-43d8-bb6f-883717538a1c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:54.155202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d95c6b40-b692-43d8-bb6f-883717538a1c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:54.238383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d95c6b40-b692-43d8-bb6f-883717538a1c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094659 Jul 28 03:54:54.238975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1093/1497] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Jul 28 03:54:54 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:54:55.164387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bbb6cdac-a487-42c2-be3b-b2f65fdfbf9a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:55.165457 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bbb6cdac-a487-42c2-be3b-b2f65fdfbf9a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:55.171461 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbb6cdac-a487-42c2-be3b-b2f65fdfbf9a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:55.172022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbb6cdac-a487-42c2-be3b-b2f65fdfbf9a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:55.172869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbb6cdac-a487-42c2-be3b-b2f65fdfbf9a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:55.173378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbb6cdac-a487-42c2-be3b-b2f65fdfbf9a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:55.255581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bbb6cdac-a487-42c2-be3b-b2f65fdfbf9a tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 14 microversion: 2.1 time: 0.094848 Jul 28 03:54:55.259114 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1094/1498] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:54:55 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:54:55.261447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-358a1d06-1c30-43da-a377-9601375cf2a8 req-0f9d40df-bfba-4221-9f75-9a57fa146a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b184416a-b6b8-447e-a592-9030cabfa404", "tag": "2226f438-8e90-4b31-a8d7-9b71702e0d00"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:55.262933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:54:55.262933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:54:55.270919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-358a1d06-1c30-43da-a377-9601375cf2a8 req-0f9d40df-bfba-4221-9f75-9a57fa146a53 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:55.271307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-358a1d06-1c30-43da-a377-9601375cf2a8 req-0f9d40df-bfba-4221-9f75-9a57fa146a53 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:55.282103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-358a1d06-1c30-43da-a377-9601375cf2a8 req-0f9d40df-bfba-4221-9f75-9a57fa146a53 service nova] Creating event network-changed:2226f438-8e90-4b31-a8d7-9b71702e0d00 for instance b184416a-b6b8-447e-a592-9030cabfa404 on hv-cinder-73306 Jul 28 03:54:55.286898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-358a1d06-1c30-43da-a377-9601375cf2a8 req-0f9d40df-bfba-4221-9f75-9a57fa146a53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029083 Jul 28 03:54:55.287542 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1095/1499] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:54:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:56.266968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ac831dfe-9ccd-4a10-88d8-4b245ec37404 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:56.268001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ac831dfe-9ccd-4a10-88d8-4b245ec37404 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:56.274440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac831dfe-9ccd-4a10-88d8-4b245ec37404 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:56.274892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac831dfe-9ccd-4a10-88d8-4b245ec37404 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:56.275654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac831dfe-9ccd-4a10-88d8-4b245ec37404 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:56.276117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac831dfe-9ccd-4a10-88d8-4b245ec37404 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:56.355796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ac831dfe-9ccd-4a10-88d8-4b245ec37404 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 14 microversion: 2.1 time: 0.092855 Jul 28 03:54:56.356403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1096/1500] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:54:56 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:54:57.366951 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9f97229f-712b-4fbd-9693-8e4dd8d269ef tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:57.367973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9f97229f-712b-4fbd-9693-8e4dd8d269ef tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:57.374559 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f97229f-712b-4fbd-9693-8e4dd8d269ef tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:57.375013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f97229f-712b-4fbd-9693-8e4dd8d269ef tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:57.375841 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f97229f-712b-4fbd-9693-8e4dd8d269ef tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:57.376286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9f97229f-712b-4fbd-9693-8e4dd8d269ef tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:57.457422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9f97229f-712b-4fbd-9693-8e4dd8d269ef tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 14 microversion: 2.1 time: 0.094324 Jul 28 03:54:57.458019 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1097/1501] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:54:57 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:54:58.468729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-67c1c974-123f-48d7-9367-1bf4eb950551 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:58.469723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-67c1c974-123f-48d7-9367-1bf4eb950551 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:58.477042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-67c1c974-123f-48d7-9367-1bf4eb950551 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:58.477485 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-67c1c974-123f-48d7-9367-1bf4eb950551 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:58.478235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-67c1c974-123f-48d7-9367-1bf4eb950551 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:58.478662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-67c1c974-123f-48d7-9367-1bf4eb950551 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:58.555971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-67c1c974-123f-48d7-9367-1bf4eb950551 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 14 microversion: 2.1 time: 0.091086 Jul 28 03:54:58.556551 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1098/1502] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:54:58 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:54:59.567490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7b59746f-f65a-41e1-907b-9ed3c74db2e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:59.568500 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7b59746f-f65a-41e1-907b-9ed3c74db2e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:54:59.574839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7b59746f-f65a-41e1-907b-9ed3c74db2e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:59.575288 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7b59746f-f65a-41e1-907b-9ed3c74db2e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:59.576148 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7b59746f-f65a-41e1-907b-9ed3c74db2e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:54:59.576584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7b59746f-f65a-41e1-907b-9ed3c74db2e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:54:59.663150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7b59746f-f65a-41e1-907b-9ed3c74db2e3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 14 microversion: 2.1 time: 0.100143 Jul 28 03:54:59.663780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1099/1503] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:54:59 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:55:00.674066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d226ede3-6a46-4289-8173-450381f03fca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:00.675105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d226ede3-6a46-4289-8173-450381f03fca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:00.681492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d226ede3-6a46-4289-8173-450381f03fca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:00.681938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d226ede3-6a46-4289-8173-450381f03fca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:00.682702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d226ede3-6a46-4289-8173-450381f03fca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:00.683135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d226ede3-6a46-4289-8173-450381f03fca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:00.761205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d226ede3-6a46-4289-8173-450381f03fca tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 14 microversion: 2.1 time: 0.091068 Jul 28 03:55:00.761937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1100/1504] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:00 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:55:01.772934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c73f3321-6dfa-419c-a254-8c063f93bcdf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:01.773962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c73f3321-6dfa-419c-a254-8c063f93bcdf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:01.780324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c73f3321-6dfa-419c-a254-8c063f93bcdf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:01.780772 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c73f3321-6dfa-419c-a254-8c063f93bcdf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:01.781529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c73f3321-6dfa-419c-a254-8c063f93bcdf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:01.781965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c73f3321-6dfa-419c-a254-8c063f93bcdf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:01.861351 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c73f3321-6dfa-419c-a254-8c063f93bcdf tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 14 microversion: 2.1 time: 0.092140 Jul 28 03:55:01.861992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1101/1505] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:01 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:55:02.872313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-338e58c5-2c16-4c16-b526-37d71b841ff8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:02.873336 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-338e58c5-2c16-4c16-b526-37d71b841ff8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:02.880000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-338e58c5-2c16-4c16-b526-37d71b841ff8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:02.880446 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-338e58c5-2c16-4c16-b526-37d71b841ff8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:02.881199 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-338e58c5-2c16-4c16-b526-37d71b841ff8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:02.881629 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-338e58c5-2c16-4c16-b526-37d71b841ff8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:02.972014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-338e58c5-2c16-4c16-b526-37d71b841ff8 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 14 microversion: 2.1 time: 0.103411 Jul 28 03:55:02.972556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1102/1506] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:02 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:55:03.983028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4e951917-8547-4d71-b93d-2697c5253e63 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:03.983992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4e951917-8547-4d71-b93d-2697c5253e63 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:03.990858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4e951917-8547-4d71-b93d-2697c5253e63 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:03.991334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4e951917-8547-4d71-b93d-2697c5253e63 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:03.992126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4e951917-8547-4d71-b93d-2697c5253e63 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:03.992560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4e951917-8547-4d71-b93d-2697c5253e63 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:04.072531 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4e951917-8547-4d71-b93d-2697c5253e63 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 14 microversion: 2.1 time: 0.093444 Jul 28 03:55:04.073143 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1103/1507] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:03 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:55:05.084683 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-da09182f-d62a-4f08-bac7-46f9b0f970f6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:05.085612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-da09182f-d62a-4f08-bac7-46f9b0f970f6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:05.091979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-da09182f-d62a-4f08-bac7-46f9b0f970f6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:05.092427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-da09182f-d62a-4f08-bac7-46f9b0f970f6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:05.093179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-da09182f-d62a-4f08-bac7-46f9b0f970f6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:05.093608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-da09182f-d62a-4f08-bac7-46f9b0f970f6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:05.180767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-da09182f-d62a-4f08-bac7-46f9b0f970f6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 14 microversion: 2.1 time: 0.101055 Jul 28 03:55:05.181403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1104/1508] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:05 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:55:06.192455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-72ea4773-89eb-4773-86d0-5cff5df7b24c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:06.193554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-72ea4773-89eb-4773-86d0-5cff5df7b24c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:06.200016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72ea4773-89eb-4773-86d0-5cff5df7b24c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:06.200474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72ea4773-89eb-4773-86d0-5cff5df7b24c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:06.201238 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72ea4773-89eb-4773-86d0-5cff5df7b24c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:06.201679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-72ea4773-89eb-4773-86d0-5cff5df7b24c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:06.297683 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-72ea4773-89eb-4773-86d0-5cff5df7b24c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 12677 microversion: 2.1 time: 0.109619 Jul 28 03:55:06.298303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1105/1509] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:06 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 12677 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:07.309405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-15506b4c-29f2-458d-ad79-54cff6b3e256 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:07.310397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-15506b4c-29f2-458d-ad79-54cff6b3e256 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:07.316920 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-15506b4c-29f2-458d-ad79-54cff6b3e256 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:07.317383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-15506b4c-29f2-458d-ad79-54cff6b3e256 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:07.318175 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-15506b4c-29f2-458d-ad79-54cff6b3e256 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:07.318645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-15506b4c-29f2-458d-ad79-54cff6b3e256 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:07.405286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-15506b4c-29f2-458d-ad79-54cff6b3e256 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 18608 microversion: 2.1 time: 0.099759 Jul 28 03:55:07.405823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1106/1510] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:07 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 18608 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:08.417186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ca8b4abd-7a86-43eb-a265-e813bbeaa22b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:08.418106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ca8b4abd-7a86-43eb-a265-e813bbeaa22b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:08.424532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca8b4abd-7a86-43eb-a265-e813bbeaa22b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:08.425278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca8b4abd-7a86-43eb-a265-e813bbeaa22b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:08.426081 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca8b4abd-7a86-43eb-a265-e813bbeaa22b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:08.426513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ca8b4abd-7a86-43eb-a265-e813bbeaa22b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:08.522918 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ca8b4abd-7a86-43eb-a265-e813bbeaa22b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 19342 microversion: 2.1 time: 0.109660 Jul 28 03:55:08.523738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1107/1511] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:08 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 19342 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:09.535335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e7ececff-387a-4e90-b309-886dbbe1931c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:09.536464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e7ececff-387a-4e90-b309-886dbbe1931c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:09.542760 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7ececff-387a-4e90-b309-886dbbe1931c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:09.543218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7ececff-387a-4e90-b309-886dbbe1931c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:09.544017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7ececff-387a-4e90-b309-886dbbe1931c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:09.544454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7ececff-387a-4e90-b309-886dbbe1931c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:09.633994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e7ececff-387a-4e90-b309-886dbbe1931c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 22119 microversion: 2.1 time: 0.103293 Jul 28 03:55:09.634642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1108/1512] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:09 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 22119 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:10.646194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-77b68581-4c44-4553-b92c-529a2458803d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:10.647213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-77b68581-4c44-4553-b92c-529a2458803d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:10.654544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77b68581-4c44-4553-b92c-529a2458803d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:10.654991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77b68581-4c44-4553-b92c-529a2458803d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:10.655788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77b68581-4c44-4553-b92c-529a2458803d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:10.656240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77b68581-4c44-4553-b92c-529a2458803d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:10.752454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-77b68581-4c44-4553-b92c-529a2458803d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 23804 microversion: 2.1 time: 0.110412 Jul 28 03:55:10.753101 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1109/1513] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:10 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 23804 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:11.764253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2cfe55fc-690f-4d61-ad28-f8f8e6c287e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:11.765254 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2cfe55fc-690f-4d61-ad28-f8f8e6c287e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:11.771783 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cfe55fc-690f-4d61-ad28-f8f8e6c287e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:11.772237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cfe55fc-690f-4d61-ad28-f8f8e6c287e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:11.773021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cfe55fc-690f-4d61-ad28-f8f8e6c287e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:11.773458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2cfe55fc-690f-4d61-ad28-f8f8e6c287e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:11.866545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2cfe55fc-690f-4d61-ad28-f8f8e6c287e5 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 25302 microversion: 2.1 time: 0.106206 Jul 28 03:55:11.867159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1110/1514] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:11 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 25302 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:12.879305 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e9986622-78cd-4a1b-84c5-f910ec9d340c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:12.880332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e9986622-78cd-4a1b-84c5-f910ec9d340c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:12.886866 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e9986622-78cd-4a1b-84c5-f910ec9d340c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:12.887356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e9986622-78cd-4a1b-84c5-f910ec9d340c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:12.888148 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e9986622-78cd-4a1b-84c5-f910ec9d340c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:12.888757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e9986622-78cd-4a1b-84c5-f910ec9d340c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:12.983221 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e9986622-78cd-4a1b-84c5-f910ec9d340c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 26951 microversion: 2.1 time: 0.108418 Jul 28 03:55:12.985204 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1111/1515] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:12 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 26951 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:13.996003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a41bb071-7e37-4f41-a5a0-8ee78f71ae39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:13.996939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a41bb071-7e37-4f41-a5a0-8ee78f71ae39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:14.003432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a41bb071-7e37-4f41-a5a0-8ee78f71ae39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:14.003924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a41bb071-7e37-4f41-a5a0-8ee78f71ae39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:14.004688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a41bb071-7e37-4f41-a5a0-8ee78f71ae39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:14.005124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a41bb071-7e37-4f41-a5a0-8ee78f71ae39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:14.097660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a41bb071-7e37-4f41-a5a0-8ee78f71ae39 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 27766 microversion: 2.1 time: 0.104985 Jul 28 03:55:14.098268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1112/1516] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:13 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 27766 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:15.109740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-70ce7e1c-be64-4460-b57b-f40ca48e2958 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:15.110731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-70ce7e1c-be64-4460-b57b-f40ca48e2958 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:15.117864 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-70ce7e1c-be64-4460-b57b-f40ca48e2958 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:15.118344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-70ce7e1c-be64-4460-b57b-f40ca48e2958 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:15.119115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-70ce7e1c-be64-4460-b57b-f40ca48e2958 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:15.119529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-70ce7e1c-be64-4460-b57b-f40ca48e2958 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:15.214429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-70ce7e1c-be64-4460-b57b-f40ca48e2958 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 28185 microversion: 2.1 time: 0.108513 Jul 28 03:55:15.215066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1113/1517] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:15 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 28185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:16.226701 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fcdd184f-c8e9-41f0-ad5a-45ea5242747b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:16.227693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fcdd184f-c8e9-41f0-ad5a-45ea5242747b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:16.234073 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fcdd184f-c8e9-41f0-ad5a-45ea5242747b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:16.234514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fcdd184f-c8e9-41f0-ad5a-45ea5242747b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:16.235291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fcdd184f-c8e9-41f0-ad5a-45ea5242747b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:16.235776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fcdd184f-c8e9-41f0-ad5a-45ea5242747b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:16.323495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fcdd184f-c8e9-41f0-ad5a-45ea5242747b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 28185 microversion: 2.1 time: 0.100913 Jul 28 03:55:16.324165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1114/1518] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:16 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 28185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:17.335909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eb7c9b26-073a-44de-9157-8933dae4b635 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:17.336896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eb7c9b26-073a-44de-9157-8933dae4b635 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:17.343579 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb7c9b26-073a-44de-9157-8933dae4b635 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:17.344125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb7c9b26-073a-44de-9157-8933dae4b635 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:17.344936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb7c9b26-073a-44de-9157-8933dae4b635 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:17.345364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb7c9b26-073a-44de-9157-8933dae4b635 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:17.436150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eb7c9b26-073a-44de-9157-8933dae4b635 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 28475 microversion: 2.1 time: 0.104586 Jul 28 03:55:17.436765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1115/1519] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:17 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 28475 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:18.449212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9dcd0616-6f6e-438d-b7ed-99b157210426 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:18.450276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9dcd0616-6f6e-438d-b7ed-99b157210426 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:18.458264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9dcd0616-6f6e-438d-b7ed-99b157210426 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:18.458726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9dcd0616-6f6e-438d-b7ed-99b157210426 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:18.459517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9dcd0616-6f6e-438d-b7ed-99b157210426 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:18.459993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9dcd0616-6f6e-438d-b7ed-99b157210426 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:18.553525 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9dcd0616-6f6e-438d-b7ed-99b157210426 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 28643 microversion: 2.1 time: 0.108220 Jul 28 03:55:18.554260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1116/1520] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:18 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 28643 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:19.566267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e8da1716-750a-4ec8-97af-ad83e67494e6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:19.567338 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e8da1716-750a-4ec8-97af-ad83e67494e6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:19.573887 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8da1716-750a-4ec8-97af-ad83e67494e6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:19.574347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8da1716-750a-4ec8-97af-ad83e67494e6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:19.575124 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8da1716-750a-4ec8-97af-ad83e67494e6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:19.575565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e8da1716-750a-4ec8-97af-ad83e67494e6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:19.668284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e8da1716-750a-4ec8-97af-ad83e67494e6 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 28643 microversion: 2.1 time: 0.106399 Jul 28 03:55:19.668896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1117/1521] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:19 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 28643 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:20.680964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9e6af34d-cc47-4fb0-b608-b12acd3fac97 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:20.681920 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9e6af34d-cc47-4fb0-b608-b12acd3fac97 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:20.688375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e6af34d-cc47-4fb0-b608-b12acd3fac97 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:20.688830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e6af34d-cc47-4fb0-b608-b12acd3fac97 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:20.689599 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e6af34d-cc47-4fb0-b608-b12acd3fac97 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:20.690038 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9e6af34d-cc47-4fb0-b608-b12acd3fac97 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:20.774882 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9e6af34d-cc47-4fb0-b608-b12acd3fac97 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 28643 microversion: 2.1 time: 0.097898 Jul 28 03:55:20.775777 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1118/1522] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:20 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 28643 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:21.786881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3ac508d9-a627-4279-b99e-17bde3f830d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:21.787996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3ac508d9-a627-4279-b99e-17bde3f830d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:21.794441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ac508d9-a627-4279-b99e-17bde3f830d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:21.794897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ac508d9-a627-4279-b99e-17bde3f830d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:21.795661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ac508d9-a627-4279-b99e-17bde3f830d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:21.796126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ac508d9-a627-4279-b99e-17bde3f830d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:21.891082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3ac508d9-a627-4279-b99e-17bde3f830d1 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 29736 microversion: 2.1 time: 0.108177 Jul 28 03:55:21.891687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1119/1523] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:21 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 29736 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:22.903743 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5ef6d4c0-8fe1-4028-8d26-e51886edd2a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:22.904735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5ef6d4c0-8fe1-4028-8d26-e51886edd2a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:22.911763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5ef6d4c0-8fe1-4028-8d26-e51886edd2a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:22.912208 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5ef6d4c0-8fe1-4028-8d26-e51886edd2a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:22.912960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5ef6d4c0-8fe1-4028-8d26-e51886edd2a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:22.913389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5ef6d4c0-8fe1-4028-8d26-e51886edd2a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:23.007211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5ef6d4c0-8fe1-4028-8d26-e51886edd2a9 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 31844 microversion: 2.1 time: 0.107343 Jul 28 03:55:23.007836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1120/1524] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:22 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 31844 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:24.018429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cfdd228d-d056-4f2c-b0f8-b1d79284be9c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:24.019418 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cfdd228d-d056-4f2c-b0f8-b1d79284be9c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:24.026165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfdd228d-d056-4f2c-b0f8-b1d79284be9c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:24.026622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfdd228d-d056-4f2c-b0f8-b1d79284be9c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:24.027395 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfdd228d-d056-4f2c-b0f8-b1d79284be9c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:24.027871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfdd228d-d056-4f2c-b0f8-b1d79284be9c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:24.117943 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cfdd228d-d056-4f2c-b0f8-b1d79284be9c tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 33397 microversion: 2.1 time: 0.103390 Jul 28 03:55:24.121990 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1121/1525] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:24 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 33397 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:25.130714 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-267dca10-add8-43c5-9fe1-1af121bad3b3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:25.131806 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-267dca10-add8-43c5-9fe1-1af121bad3b3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:25.138279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-267dca10-add8-43c5-9fe1-1af121bad3b3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:25.138732 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-267dca10-add8-43c5-9fe1-1af121bad3b3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:25.139495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-267dca10-add8-43c5-9fe1-1af121bad3b3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:25.139971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-267dca10-add8-43c5-9fe1-1af121bad3b3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:25.229565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-267dca10-add8-43c5-9fe1-1af121bad3b3 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 34363 microversion: 2.1 time: 0.103349 Jul 28 03:55:25.233556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1122/1526] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:25 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 34363 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:26.241935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-84dfab85-0601-4576-80f8-f7957d747d75 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:26.242960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-84dfab85-0601-4576-80f8-f7957d747d75 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:26.249439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84dfab85-0601-4576-80f8-f7957d747d75 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:26.249897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84dfab85-0601-4576-80f8-f7957d747d75 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:26.250675 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84dfab85-0601-4576-80f8-f7957d747d75 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:26.251110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-84dfab85-0601-4576-80f8-f7957d747d75 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:26.341947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-84dfab85-0601-4576-80f8-f7957d747d75 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 35502 microversion: 2.1 time: 0.103998 Jul 28 03:55:26.347016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1123/1527] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:26 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 35502 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:27.354889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e48d80fd-326e-4d94-9f64-ce1a7ca6002f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:27.355924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e48d80fd-326e-4d94-9f64-ce1a7ca6002f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:27.362430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e48d80fd-326e-4d94-9f64-ce1a7ca6002f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:27.362920 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e48d80fd-326e-4d94-9f64-ce1a7ca6002f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:27.363682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e48d80fd-326e-4d94-9f64-ce1a7ca6002f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:27.364142 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e48d80fd-326e-4d94-9f64-ce1a7ca6002f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:27.453169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e48d80fd-326e-4d94-9f64-ce1a7ca6002f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 37081 microversion: 2.1 time: 0.102361 Jul 28 03:55:27.454163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1124/1528] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:27 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 37081 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:28.465917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3d0328f1-9555-474a-98f8-3c21c31a39d4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:28.466915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3d0328f1-9555-474a-98f8-3c21c31a39d4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:28.473973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d0328f1-9555-474a-98f8-3c21c31a39d4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:28.474674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d0328f1-9555-474a-98f8-3c21c31a39d4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:28.475364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d0328f1-9555-474a-98f8-3c21c31a39d4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:28.476073 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3d0328f1-9555-474a-98f8-3c21c31a39d4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:28.567343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3d0328f1-9555-474a-98f8-3c21c31a39d4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 38176 microversion: 2.1 time: 0.105240 Jul 28 03:55:28.568004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1125/1529] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:28 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 38176 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:29.578768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8dd5122c-b72d-49df-8616-b5cf3c2cd24d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:29.579793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8dd5122c-b72d-49df-8616-b5cf3c2cd24d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:29.586992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8dd5122c-b72d-49df-8616-b5cf3c2cd24d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:29.587441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8dd5122c-b72d-49df-8616-b5cf3c2cd24d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:29.588240 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8dd5122c-b72d-49df-8616-b5cf3c2cd24d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:29.588678 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8dd5122c-b72d-49df-8616-b5cf3c2cd24d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:29.669726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8dd5122c-b72d-49df-8616-b5cf3c2cd24d tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 38176 microversion: 2.1 time: 0.094846 Jul 28 03:55:29.670735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1126/1530] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:29 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 38176 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:30.681782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7786c722-dc35-4a6e-89c2-667e31112776 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:30.682784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7786c722-dc35-4a6e-89c2-667e31112776 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:30.689218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7786c722-dc35-4a6e-89c2-667e31112776 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:30.689669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7786c722-dc35-4a6e-89c2-667e31112776 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:30.690489 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7786c722-dc35-4a6e-89c2-667e31112776 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:30.690925 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7786c722-dc35-4a6e-89c2-667e31112776 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:30.774437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7786c722-dc35-4a6e-89c2-667e31112776 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 38176 microversion: 2.1 time: 0.096502 Jul 28 03:55:30.775074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1127/1531] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:30 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 38176 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:31.786805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-08e7c8a0-2d9a-44fb-b328-223f17d09c2b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:31.787853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-08e7c8a0-2d9a-44fb-b328-223f17d09c2b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:31.794245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08e7c8a0-2d9a-44fb-b328-223f17d09c2b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:31.794699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08e7c8a0-2d9a-44fb-b328-223f17d09c2b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:31.795462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08e7c8a0-2d9a-44fb-b328-223f17d09c2b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:31.795926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08e7c8a0-2d9a-44fb-b328-223f17d09c2b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:31.877318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-08e7c8a0-2d9a-44fb-b328-223f17d09c2b tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 38176 microversion: 2.1 time: 0.094899 Jul 28 03:55:31.877944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1128/1532] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:31 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 38176 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:32.889598 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a18280a9-1681-40ca-b5ed-e5db4e7df706 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:32.890590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a18280a9-1681-40ca-b5ed-e5db4e7df706 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:32.897132 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a18280a9-1681-40ca-b5ed-e5db4e7df706 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:32.897576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a18280a9-1681-40ca-b5ed-e5db4e7df706 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:32.898327 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a18280a9-1681-40ca-b5ed-e5db4e7df706 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:32.898754 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a18280a9-1681-40ca-b5ed-e5db4e7df706 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:32.989754 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a18280a9-1681-40ca-b5ed-e5db4e7df706 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action" status: 200 len: 38307 microversion: 2.1 time: 0.104041 Jul 28 03:55:32.990285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1129/1533] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 03:55:32 2021] POST /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/action => generated 38307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:32.999852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1e3cc217-55b2-45dd-a96d-bc68997d20f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:33.000417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1e3cc217-55b2-45dd-a96d-bc68997d20f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:55:33.006919 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e3cc217-55b2-45dd-a96d-bc68997d20f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:33.007393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e3cc217-55b2-45dd-a96d-bc68997d20f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:33.008188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e3cc217-55b2-45dd-a96d-bc68997d20f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:55:33.008633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1e3cc217-55b2-45dd-a96d-bc68997d20f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:55:33.031325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1e3cc217-55b2-45dd-a96d-bc68997d20f4 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/ips" status: 200 len: 145 microversion: 2.1 time: 0.035058 Jul 28 03:55:33.031908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1130/1534] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Jul 28 03:55:32 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:56:27.345032 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cfc5332c-2ca3-4ee1-907d-c520e0fe09d8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:27.346294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cfc5332c-2ca3-4ee1-907d-c520e0fe09d8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:56:27.352205 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfc5332c-2ca3-4ee1-907d-c520e0fe09d8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:56:27.352661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfc5332c-2ca3-4ee1-907d-c520e0fe09d8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:56:27.353426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfc5332c-2ca3-4ee1-907d-c520e0fe09d8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:56:27.353861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cfc5332c-2ca3-4ee1-907d-c520e0fe09d8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:56:27.378150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cfc5332c-2ca3-4ee1-907d-c520e0fe09d8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:56:27.450162 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cfc5332c-2ca3-4ee1-907d-c520e0fe09d8 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 204 len: 0 microversion: 2.20 time: 0.108402 Jul 28 03:56:27.450997 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1131/1535] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Jul 28 03:56:27 2021] DELETE /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 03:56:27.460034 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-868e9d84-aec0-42b9-b574-921ec194bf63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:27.460732 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-868e9d84-aec0-42b9-b574-921ec194bf63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:56:27.466366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-868e9d84-aec0-42b9-b574-921ec194bf63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:56:27.466852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-868e9d84-aec0-42b9-b574-921ec194bf63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:56:27.467641 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-868e9d84-aec0-42b9-b574-921ec194bf63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:56:27.468092 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-868e9d84-aec0-42b9-b574-921ec194bf63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:56:27.591570 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-868e9d84-aec0-42b9-b574-921ec194bf63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:27.599991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-868e9d84-aec0-42b9-b574-921ec194bf63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:27.601752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-868e9d84-aec0-42b9-b574-921ec194bf63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:27.602883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-868e9d84-aec0-42b9-b574-921ec194bf63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1724 microversion: 2.20 time: 0.146816 Jul 28 03:56:27.603429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1132/1536] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:56:27 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:56:28.623096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e2703c4d-0987-41cd-9761-8504af452d63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:28.623721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e2703c4d-0987-41cd-9761-8504af452d63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:56:28.632697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2703c4d-0987-41cd-9761-8504af452d63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:56:28.633146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2703c4d-0987-41cd-9761-8504af452d63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:56:28.633931 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2703c4d-0987-41cd-9761-8504af452d63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:56:28.634346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e2703c4d-0987-41cd-9761-8504af452d63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:56:28.695832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e2703c4d-0987-41cd-9761-8504af452d63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:28.703457 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e2703c4d-0987-41cd-9761-8504af452d63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:28.705113 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e2703c4d-0987-41cd-9761-8504af452d63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fd82b48aabbb419cb891867d0b1a57e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee20ad097bcc4c51a357aa0a803f59a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:28.706253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e2703c4d-0987-41cd-9761-8504af452d63 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 200 len: 1656 microversion: 2.20 time: 0.088751 Jul 28 03:56:28.706811 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1133/1537] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:56:28 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 1656 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:28.884085 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-20fbc54c-8878-4627-8d7e-633b48c657f4 req-e75d65f1-d698-45bc-b31f-4d5bc4f4d52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb93149a-aac0-4bcd-af4a-16726ab6d1df", "name": "network-vif-deleted", "tag": "4131a892-3af6-42e1-baaf-3d85313cb04d"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:28.885628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:56:28.885628 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:56:28.893802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-20fbc54c-8878-4627-8d7e-633b48c657f4 req-e75d65f1-d698-45bc-b31f-4d5bc4f4d52c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:56:28.894013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-20fbc54c-8878-4627-8d7e-633b48c657f4 req-e75d65f1-d698-45bc-b31f-4d5bc4f4d52c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:56:28.905479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-20fbc54c-8878-4627-8d7e-633b48c657f4 req-e75d65f1-d698-45bc-b31f-4d5bc4f4d52c service nova] Creating event network-vif-deleted:4131a892-3af6-42e1-baaf-3d85313cb04d for instance fb93149a-aac0-4bcd-af4a-16726ab6d1df on hv-cinder-73306 Jul 28 03:56:28.911100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-20fbc54c-8878-4627-8d7e-633b48c657f4 req-e75d65f1-d698-45bc-b31f-4d5bc4f4d52c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030402 Jul 28 03:56:28.914715 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1134/1538] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:56:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:56:29.724738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d6f5b207-d3f5-4bb8-953f-7a80c366294a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:29.725436 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d6f5b207-d3f5-4bb8-953f-7a80c366294a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:56:29.731730 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d6f5b207-d3f5-4bb8-953f-7a80c366294a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:56:29.732227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d6f5b207-d3f5-4bb8-953f-7a80c366294a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:56:29.732986 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d6f5b207-d3f5-4bb8-953f-7a80c366294a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:56:29.733420 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d6f5b207-d3f5-4bb8-953f-7a80c366294a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:56:29.747160 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-d6f5b207-d3f5-4bb8-953f-7a80c366294a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] HTTP exception thrown: Instance fb93149a-aac0-4bcd-af4a-16726ab6d1df could not be found. Jul 28 03:56:29.747814 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d6f5b207-d3f5-4bb8-953f-7a80c366294a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Returning 404 to user: Instance fb93149a-aac0-4bcd-af4a-16726ab6d1df could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:56:29.748620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d6f5b207-d3f5-4bb8-953f-7a80c366294a tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 404 len: 111 microversion: 2.20 time: 0.028078 Jul 28 03:56:29.749156 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1135/1539] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Jul 28 03:56:29 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:56:29.757904 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-882a9b3a-a5cd-486a-8e60-8c10d7d84632 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '.version_select at 0x7f68086e2ca0>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:29.776077 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-882a9b3a-a5cd-486a-8e60-8c10d7d84632 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390679599" status: 204 len: 0 microversion: 2.20 time: 0.021687 Jul 28 03:56:29.776652 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1136/1540] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Jul 28 03:56:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1390679599 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:57:15.032851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:57:15.033687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 03:57:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 03:58:40.813935 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 03:58:40.817568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-17e3b3a8-6560-4414-8351-463104f21eb0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:40.818071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-17e3b3a8-6560-4414-8351-463104f21eb0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:58:40.825235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17e3b3a8-6560-4414-8351-463104f21eb0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:40.825722 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17e3b3a8-6560-4414-8351-463104f21eb0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:40.826497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17e3b3a8-6560-4414-8351-463104f21eb0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:40.826934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17e3b3a8-6560-4414-8351-463104f21eb0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:40.850971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-17e3b3a8-6560-4414-8351-463104f21eb0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:58:40.924454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-17e3b3a8-6560-4414-8351-463104f21eb0 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 204 len: 0 microversion: 2.1 time: 0.111952 Jul 28 03:58:40.925029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1137/1541] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:58:40 2021] DELETE /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:58:40.935187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c1665169-4c25-4590-ad61-6e7007488c54 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:40.935963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c1665169-4c25-4590-ad61-6e7007488c54 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:58:40.941507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1665169-4c25-4590-ad61-6e7007488c54 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:40.941950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1665169-4c25-4590-ad61-6e7007488c54 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:40.942721 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1665169-4c25-4590-ad61-6e7007488c54 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:40.943148 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c1665169-4c25-4590-ad61-6e7007488c54 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:41.110804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c1665169-4c25-4590-ad61-6e7007488c54 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:41.119161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c1665169-4c25-4590-ad61-6e7007488c54 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1507 microversion: 2.1 time: 0.187886 Jul 28 03:58:41.119750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1138/1542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:58:40 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:42.052028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-6061f93f-071d-4fb3-a220-cdbb3302de2e req-5b4c069a-f53d-4145-86e4-d8482656254d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ff2a400-ddb8-40da-9f6e-09ebc33da17c", "name": "network-vif-deleted", "tag": "29cc949d-5a73-4ff7-a43e-00ddd4fbc84b"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:42.053831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:58:42.053831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:58:42.073490 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-6061f93f-071d-4fb3-a220-cdbb3302de2e req-5b4c069a-f53d-4145-86e4-d8482656254d service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:42.073927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-6061f93f-071d-4fb3-a220-cdbb3302de2e req-5b4c069a-f53d-4145-86e4-d8482656254d service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:42.086565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-6061f93f-071d-4fb3-a220-cdbb3302de2e req-5b4c069a-f53d-4145-86e4-d8482656254d service nova] Creating event network-vif-deleted:29cc949d-5a73-4ff7-a43e-00ddd4fbc84b for instance 3ff2a400-ddb8-40da-9f6e-09ebc33da17c on hv-cinder-73306 Jul 28 03:58:42.090016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37884. Jul 28 03:58:42.091620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-6061f93f-071d-4fb3-a220-cdbb3302de2e req-5b4c069a-f53d-4145-86e4-d8482656254d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043119 Jul 28 03:58:42.092230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1139/1543] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:58:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:42.137244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:42.138090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:58:42.144547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:42.145056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:42.145849 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:42.146264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:42.180725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:42.181090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:42.181534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lazy-loading 'fault' on Instance uuid 3ff2a400-ddb8-40da-9f6e-09ebc33da17c {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:58:42.222473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:42.229968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5ba5a490-5c2e-4eec-94ca-6a0de5dada0c tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 200 len: 1311 microversion: 2.1 time: 0.096945 Jul 28 03:58:42.230521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1140/1544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:58:42 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:58:43.246089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0b61df64-1e0d-4fa3-9d84-16d8b7ef7cf2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:43.246737 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0b61df64-1e0d-4fa3-9d84-16d8b7ef7cf2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: 3ff2a400-ddb8-40da-9f6e-09ebc33da17c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:58:43.252544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0b61df64-1e0d-4fa3-9d84-16d8b7ef7cf2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:43.252993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0b61df64-1e0d-4fa3-9d84-16d8b7ef7cf2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:43.253750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0b61df64-1e0d-4fa3-9d84-16d8b7ef7cf2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:43.254185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0b61df64-1e0d-4fa3-9d84-16d8b7ef7cf2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:43.267619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-0b61df64-1e0d-4fa3-9d84-16d8b7ef7cf2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] HTTP exception thrown: Instance 3ff2a400-ddb8-40da-9f6e-09ebc33da17c could not be found. Jul 28 03:58:43.268218 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0b61df64-1e0d-4fa3-9d84-16d8b7ef7cf2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Returning 404 to user: Instance 3ff2a400-ddb8-40da-9f6e-09ebc33da17c could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:58:43.269016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0b61df64-1e0d-4fa3-9d84-16d8b7ef7cf2 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c" status: 404 len: 111 microversion: 2.1 time: 0.026603 Jul 28 03:58:43.269652 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1141/1545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:58:43 2021] GET /compute/v2.1/servers/3ff2a400-ddb8-40da-9f6e-09ebc33da17c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:43.277449 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-12db0bd8-7c5d-4498-9b3e-e7fc09421778 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:43.277940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-12db0bd8-7c5d-4498-9b3e-e7fc09421778 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:58:43.283295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-12db0bd8-7c5d-4498-9b3e-e7fc09421778 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:43.283691 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-12db0bd8-7c5d-4498-9b3e-e7fc09421778 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:43.284467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-12db0bd8-7c5d-4498-9b3e-e7fc09421778 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:43.284901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-12db0bd8-7c5d-4498-9b3e-e7fc09421778 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:43.308820 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-12db0bd8-7c5d-4498-9b3e-e7fc09421778 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 03:58:43.379100 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-12db0bd8-7c5d-4498-9b3e-e7fc09421778 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 204 len: 0 microversion: 2.1 time: 0.104592 Jul 28 03:58:43.379684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1142/1546] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 03:58:43 2021] DELETE /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:58:43.389150 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9afd595d-8f39-496f-afac-a6073ec2419d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:43.389831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9afd595d-8f39-496f-afac-a6073ec2419d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:58:43.395394 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9afd595d-8f39-496f-afac-a6073ec2419d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:43.395883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9afd595d-8f39-496f-afac-a6073ec2419d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:43.396635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9afd595d-8f39-496f-afac-a6073ec2419d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:43.397679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9afd595d-8f39-496f-afac-a6073ec2419d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:43.520853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9afd595d-8f39-496f-afac-a6073ec2419d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:43.528710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9afd595d-8f39-496f-afac-a6073ec2419d tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1520 microversion: 2.1 time: 0.143453 Jul 28 03:58:43.529257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1143/1547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:58:43 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:58:44.378435 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-1881a954-72b8-44c2-ac89-bd774164b063 req-bf6e6b5f-7c9a-4a0f-a326-1b61c58cfaae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eae018-81cf-4d77-8ac7-562c54a93e53", "name": "network-vif-deleted", "tag": "1a641e29-3c70-42ab-97b9-e16e6ab74607"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:44.380605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:58:44.380605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 03:58:44.388612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-1881a954-72b8-44c2-ac89-bd774164b063 req-bf6e6b5f-7c9a-4a0f-a326-1b61c58cfaae service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:44.389180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-1881a954-72b8-44c2-ac89-bd774164b063 req-bf6e6b5f-7c9a-4a0f-a326-1b61c58cfaae service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:44.401440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-1881a954-72b8-44c2-ac89-bd774164b063 req-bf6e6b5f-7c9a-4a0f-a326-1b61c58cfaae service nova] Creating event network-vif-deleted:1a641e29-3c70-42ab-97b9-e16e6ab74607 for instance a9eae018-81cf-4d77-8ac7-562c54a93e53 on hv-cinder-73306 Jul 28 03:58:44.407791 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-1881a954-72b8-44c2-ac89-bd774164b063 req-bf6e6b5f-7c9a-4a0f-a326-1b61c58cfaae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033002 Jul 28 03:58:44.408380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1144/1548] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 03:58:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:58:44.545416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:44.546115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:58:44.552623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:44.553074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:44.553864 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:44.554304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:44.583463 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:44.583951 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:44.584401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lazy-loading 'fault' on Instance uuid a9eae018-81cf-4d77-8ac7-562c54a93e53 {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 03:58:44.625261 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90c3a2e7255c4a909fc7e09730344930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89e53e09771a4a478b48fa6e6f571d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:44.632581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ad8a49d1-0069-4441-92f4-1789d8db87cf tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 200 len: 1399 microversion: 2.1 time: 0.091098 Jul 28 03:58:44.633135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1145/1549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:58:44 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 1399 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:58:45.649375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8df787f5-ee0b-4d2b-a28f-13f46a4e0bf9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:45.650029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8df787f5-ee0b-4d2b-a28f-13f46a4e0bf9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] [instance: a9eae018-81cf-4d77-8ac7-562c54a93e53] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 03:58:45.655908 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8df787f5-ee0b-4d2b-a28f-13f46a4e0bf9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:45.656359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8df787f5-ee0b-4d2b-a28f-13f46a4e0bf9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:45.657116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8df787f5-ee0b-4d2b-a28f-13f46a4e0bf9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 03:58:45.657548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8df787f5-ee0b-4d2b-a28f-13f46a4e0bf9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 03:58:45.671214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-8df787f5-ee0b-4d2b-a28f-13f46a4e0bf9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] HTTP exception thrown: Instance a9eae018-81cf-4d77-8ac7-562c54a93e53 could not be found. Jul 28 03:58:45.671832 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8df787f5-ee0b-4d2b-a28f-13f46a4e0bf9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] Returning 404 to user: Instance a9eae018-81cf-4d77-8ac7-562c54a93e53 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 03:58:45.672648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8df787f5-ee0b-4d2b-a28f-13f46a4e0bf9 tempest-ServerRescueNegativeTestJSON-2106847959 tempest-ServerRescueNegativeTestJSON-2106847959-project] 10.222.0.16 "GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53" status: 404 len: 111 microversion: 2.1 time: 0.027374 Jul 28 03:58:45.673174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1146/1550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 03:58:45 2021] GET /compute/v2.1/servers/a9eae018-81cf-4d77-8ac7-562c54a93e53 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:59:07.456890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:59:07.457516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 03:59:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:00:35.049903 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:00:35.050509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:00:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:01:33.636855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2feaeb56-ba4e-4031-b763-c622e6fbe260 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:33.637488 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2feaeb56-ba4e-4031-b763-c622e6fbe260 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:01:33.643695 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2feaeb56-ba4e-4031-b763-c622e6fbe260 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:01:33.644175 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2feaeb56-ba4e-4031-b763-c622e6fbe260 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:01:33.644934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2feaeb56-ba4e-4031-b763-c622e6fbe260 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:01:33.645368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2feaeb56-ba4e-4031-b763-c622e6fbe260 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:01:33.668833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2feaeb56-ba4e-4031-b763-c622e6fbe260 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 04:01:33.739616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2feaeb56-ba4e-4031-b763-c622e6fbe260 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 204 len: 0 microversion: 2.1 time: 0.108418 Jul 28 04:01:33.740216 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1147/1551] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:01:33 2021] DELETE /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:01:33.749201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-78c77a99-e586-45fd-ae90-ef9b488b0b15 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:33.749897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-78c77a99-e586-45fd-ae90-ef9b488b0b15 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:01:33.755407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-78c77a99-e586-45fd-ae90-ef9b488b0b15 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:01:33.755901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-78c77a99-e586-45fd-ae90-ef9b488b0b15 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:01:33.756664 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-78c77a99-e586-45fd-ae90-ef9b488b0b15 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:01:33.757102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-78c77a99-e586-45fd-ae90-ef9b488b0b15 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:01:33.879645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-78c77a99-e586-45fd-ae90-ef9b488b0b15 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:33.888040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-78c77a99-e586-45fd-ae90-ef9b488b0b15 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1672 microversion: 2.1 time: 0.142670 Jul 28 04:01:33.888592 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1148/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:01:33 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1672 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:34.905530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-21e9d9f8-7700-43bf-a9e7-2564001ae133 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:34.906432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-21e9d9f8-7700-43bf-a9e7-2564001ae133 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:01:34.912459 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-21e9d9f8-7700-43bf-a9e7-2564001ae133 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:01:34.913027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-21e9d9f8-7700-43bf-a9e7-2564001ae133 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:01:34.914055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-21e9d9f8-7700-43bf-a9e7-2564001ae133 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:01:34.914603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-21e9d9f8-7700-43bf-a9e7-2564001ae133 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:01:34.979788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-21e9d9f8-7700-43bf-a9e7-2564001ae133 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faf7da464d4c44db918dd6c5076846e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e20265dc285042d5ab0d2e9237fe9fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:34.987848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-21e9d9f8-7700-43bf-a9e7-2564001ae133 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 200 len: 1605 microversion: 2.1 time: 0.085765 Jul 28 04:01:34.988438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1149/1553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:01:34 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 1605 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:35.359739 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-3ae9c315-b75e-42a2-83ce-99366df04d12 req-c4739d50-5c75-4cfd-9a5b-df398ba8d865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b184416a-b6b8-447e-a592-9030cabfa404", "name": "network-vif-deleted", "tag": "2226f438-8e90-4b31-a8d7-9b71702e0d00"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:35.361310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:01:35.361310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:01:35.368706 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-3ae9c315-b75e-42a2-83ce-99366df04d12 req-c4739d50-5c75-4cfd-9a5b-df398ba8d865 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:01:35.369357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-3ae9c315-b75e-42a2-83ce-99366df04d12 req-c4739d50-5c75-4cfd-9a5b-df398ba8d865 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:01:35.380428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-3ae9c315-b75e-42a2-83ce-99366df04d12 req-c4739d50-5c75-4cfd-9a5b-df398ba8d865 service nova] Creating event network-vif-deleted:2226f438-8e90-4b31-a8d7-9b71702e0d00 for instance b184416a-b6b8-447e-a592-9030cabfa404 on hv-cinder-73306 Jul 28 04:01:35.385926 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-3ae9c315-b75e-42a2-83ce-99366df04d12 req-c4739d50-5c75-4cfd-9a5b-df398ba8d865 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254525 Jul 28 04:01:35.386510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1150/1554] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:01:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:36.005878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e46e09f4-f428-4b41-bc75-3ff367cc6800 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:36.006605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e46e09f4-f428-4b41-bc75-3ff367cc6800 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:01:36.013189 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e46e09f4-f428-4b41-bc75-3ff367cc6800 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:01:36.013652 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e46e09f4-f428-4b41-bc75-3ff367cc6800 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:01:36.014455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e46e09f4-f428-4b41-bc75-3ff367cc6800 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:01:36.014890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e46e09f4-f428-4b41-bc75-3ff367cc6800 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:01:36.027877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-e46e09f4-f428-4b41-bc75-3ff367cc6800 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] HTTP exception thrown: Instance b184416a-b6b8-447e-a592-9030cabfa404 could not be found. Jul 28 04:01:36.028472 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e46e09f4-f428-4b41-bc75-3ff367cc6800 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Returning 404 to user: Instance b184416a-b6b8-447e-a592-9030cabfa404 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:01:36.029295 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e46e09f4-f428-4b41-bc75-3ff367cc6800 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 404 len: 111 microversion: 2.1 time: 0.027480 Jul 28 04:01:36.029816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1151/1555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:01:36 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:01:36.037559 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-231c662f-bc56-496c-a0cc-40d638638585 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '.version_select at 0x7f68068cf040>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:36.059433 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-231c662f-bc56-496c-a0cc-40d638638585 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-100883603" status: 202 len: 0 microversion: 2.1 time: 0.025005 Jul 28 04:01:36.059965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1152/1556] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Jul 28 04:01:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-100883603 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:02:30.056148 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 04:02:30.059479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5554ef4b-416e-4197-8e3f-23d1824cca76 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:30.060037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5554ef4b-416e-4197-8e3f-23d1824cca76 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:02:30.066470 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5554ef4b-416e-4197-8e3f-23d1824cca76 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:02:30.066921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5554ef4b-416e-4197-8e3f-23d1824cca76 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:02:30.067677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5554ef4b-416e-4197-8e3f-23d1824cca76 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:02:30.068135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5554ef4b-416e-4197-8e3f-23d1824cca76 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:02:30.081171 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-5554ef4b-416e-4197-8e3f-23d1824cca76 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] HTTP exception thrown: Instance fb93149a-aac0-4bcd-af4a-16726ab6d1df could not be found. Jul 28 04:02:30.081747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5554ef4b-416e-4197-8e3f-23d1824cca76 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Returning 404 to user: Instance fb93149a-aac0-4bcd-af4a-16726ab6d1df could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:02:30.082546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5554ef4b-416e-4197-8e3f-23d1824cca76 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 404 len: 111 microversion: 2.1 time: 0.028004 Jul 28 04:02:30.083045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1153/1557] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:02:30 2021] DELETE /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:02:30.090927 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cf8ad678-2178-4571-9960-561c8c09acbc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:30.091558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cf8ad678-2178-4571-9960-561c8c09acbc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: fb93149a-aac0-4bcd-af4a-16726ab6d1df] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:02:30.097015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf8ad678-2178-4571-9960-561c8c09acbc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:02:30.097460 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf8ad678-2178-4571-9960-561c8c09acbc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:02:30.098203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf8ad678-2178-4571-9960-561c8c09acbc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:02:30.098631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf8ad678-2178-4571-9960-561c8c09acbc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:02:30.111167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-cf8ad678-2178-4571-9960-561c8c09acbc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] HTTP exception thrown: Instance fb93149a-aac0-4bcd-af4a-16726ab6d1df could not be found. Jul 28 04:02:30.111746 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cf8ad678-2178-4571-9960-561c8c09acbc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Returning 404 to user: Instance fb93149a-aac0-4bcd-af4a-16726ab6d1df could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:02:30.112532 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cf8ad678-2178-4571-9960-561c8c09acbc tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df" status: 404 len: 111 microversion: 2.1 time: 0.024961 Jul 28 04:02:30.113016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1154/1558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:02:30 2021] GET /compute/v2.1/servers/fb93149a-aac0-4bcd-af4a-16726ab6d1df => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:03:55.066993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:03:55.067602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:03:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:04:07.476092 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:04:07.476790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:04:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:04:10.886716 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:04:10.887344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:04:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:07:15.084037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:07:15.084655 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:07:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:07:27.492708 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:07:27.493343 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:07:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:07:30.905341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:07:30.905917 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:07:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:07:36.210203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-37d97ec1-d57e-4227-96bd-85fb522ca19e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:36.210774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-37d97ec1-d57e-4227-96bd-85fb522ca19e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:07:36.216725 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37d97ec1-d57e-4227-96bd-85fb522ca19e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:07:36.217178 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37d97ec1-d57e-4227-96bd-85fb522ca19e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:07:36.217944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37d97ec1-d57e-4227-96bd-85fb522ca19e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:07:36.218375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37d97ec1-d57e-4227-96bd-85fb522ca19e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:07:36.233164 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42204. Jul 28 04:07:36.234219 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-37d97ec1-d57e-4227-96bd-85fb522ca19e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] HTTP exception thrown: Instance b184416a-b6b8-447e-a592-9030cabfa404 could not be found. Jul 28 04:07:36.235517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-37d97ec1-d57e-4227-96bd-85fb522ca19e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Returning 404 to user: Instance b184416a-b6b8-447e-a592-9030cabfa404 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:07:36.236422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-37d97ec1-d57e-4227-96bd-85fb522ca19e tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 404 len: 111 microversion: 2.1 time: 0.040604 Jul 28 04:07:36.236945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1155/1559] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:07:36 2021] DELETE /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:07:36.244305 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ab6fa5f3-fe62-4f10-bd94-d0f28bd79984 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:36.244907 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ab6fa5f3-fe62-4f10-bd94-d0f28bd79984 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: b184416a-b6b8-447e-a592-9030cabfa404] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:07:36.250418 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab6fa5f3-fe62-4f10-bd94-d0f28bd79984 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:07:36.250863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab6fa5f3-fe62-4f10-bd94-d0f28bd79984 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:07:36.251611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab6fa5f3-fe62-4f10-bd94-d0f28bd79984 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:07:36.252072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab6fa5f3-fe62-4f10-bd94-d0f28bd79984 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:07:36.265038 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-ab6fa5f3-fe62-4f10-bd94-d0f28bd79984 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] HTTP exception thrown: Instance b184416a-b6b8-447e-a592-9030cabfa404 could not be found. Jul 28 04:07:36.265611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ab6fa5f3-fe62-4f10-bd94-d0f28bd79984 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Returning 404 to user: Instance b184416a-b6b8-447e-a592-9030cabfa404 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:07:36.266453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ab6fa5f3-fe62-4f10-bd94-d0f28bd79984 tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404" status: 404 len: 111 microversion: 2.1 time: 0.025661 Jul 28 04:07:36.266962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1156/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:07:36 2021] GET /compute/v2.1/servers/b184416a-b6b8-447e-a592-9030cabfa404 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:08:30.026123 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8fab9df6-bde7-4c5b-974d-6f4360670ec6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:30.026770 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8fab9df6-bde7-4c5b-974d-6f4360670ec6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:08:30.032519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8fab9df6-bde7-4c5b-974d-6f4360670ec6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:08:30.032970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8fab9df6-bde7-4c5b-974d-6f4360670ec6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:08:30.033732 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8fab9df6-bde7-4c5b-974d-6f4360670ec6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:08:30.034169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8fab9df6-bde7-4c5b-974d-6f4360670ec6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:08:30.047469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-8fab9df6-bde7-4c5b-974d-6f4360670ec6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] HTTP exception thrown: Instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f could not be found. Jul 28 04:08:30.048071 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8fab9df6-bde7-4c5b-974d-6f4360670ec6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Returning 404 to user: Instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:08:30.048869 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8fab9df6-bde7-4c5b-974d-6f4360670ec6 tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "DELETE /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 404 len: 111 microversion: 2.1 time: 0.026400 Jul 28 04:08:30.049369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1157/1561] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:08:30 2021] DELETE /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:08:30.056341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-799ac3fa-e6f0-4f1f-b9e7-040653d0711d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:30.056940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-799ac3fa-e6f0-4f1f-b9e7-040653d0711d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] [instance: 622af242-a6fc-4f2d-9f03-61e88ee5e89f] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:08:30.062833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-799ac3fa-e6f0-4f1f-b9e7-040653d0711d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:08:30.063285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-799ac3fa-e6f0-4f1f-b9e7-040653d0711d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:08:30.064067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-799ac3fa-e6f0-4f1f-b9e7-040653d0711d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:08:30.064501 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-799ac3fa-e6f0-4f1f-b9e7-040653d0711d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:08:30.077028 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-799ac3fa-e6f0-4f1f-b9e7-040653d0711d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] HTTP exception thrown: Instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f could not be found. Jul 28 04:08:30.077605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-799ac3fa-e6f0-4f1f-b9e7-040653d0711d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] Returning 404 to user: Instance 622af242-a6fc-4f2d-9f03-61e88ee5e89f could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:08:30.078392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-799ac3fa-e6f0-4f1f-b9e7-040653d0711d tempest-AttachVolumeShelveTestJSON-1637207116 tempest-AttachVolumeShelveTestJSON-1637207116-project] 10.222.0.16 "GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f" status: 404 len: 111 microversion: 2.1 time: 0.025298 Jul 28 04:08:30.078884 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1158/1562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:08:30 2021] GET /compute/v2.1/servers/622af242-a6fc-4f2d-9f03-61e88ee5e89f => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:10:35.108056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:10:35.108719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:10:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:10:47.509168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:10:47.509747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:10:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:10:50.923545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:10:50.924729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:10:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:12:26.156087 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 04:12:26.362663 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a48b67b3-5c42-484f-9822-2c55423e5352 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Action: 'create', calling method: .version_select at 0x7f6806942af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1625188612"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:26.383282 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-a48b67b3-5c42-484f-9822-2c55423e5352 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Getting quotas for project 699932c5162645f89bbd9d95710d863b. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 04:12:26.387029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-a48b67b3-5c42-484f-9822-2c55423e5352 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Getting quotas for user 21290886e90f45f582840b785d64cd43 and project 699932c5162645f89bbd9d95710d863b. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 04:12:26.495397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-a48b67b3-5c42-484f-9822-2c55423e5352 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Getting quotas for project 699932c5162645f89bbd9d95710d863b. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 04:12:26.499004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-a48b67b3-5c42-484f-9822-2c55423e5352 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Getting quotas for user 21290886e90f45f582840b785d64cd43 and project 699932c5162645f89bbd9d95710d863b. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 04:12:26.511861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a48b67b3-5c42-484f-9822-2c55423e5352 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.357816 Jul 28 04:12:26.512451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1159/1563] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jul 28 04:12:26 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:58.184861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-801487201", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1625188612", "security_groups": [{"name": "tempest-secgroup-smoke-1739001634"}], "block_device_mapping_v2": [{"uuid": "d787cfea-b837-4be1-b060-405ca577292c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9995752f-26c8-499b-851d-ac24052e53ae"}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:58.204822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 46076. Jul 28 04:12:58.449368 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] validate_networks() for [('9995752f-26c8-499b-851d-ac24052e53ae', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 04:12:59.147001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:12:59.147429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:12:59.147932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:12:59.148344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:12:59.148759 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:12:59.157210 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:12:59.157657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:12:59.158455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:12:59.158893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:12:59.175797 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Getting quotas for project 699932c5162645f89bbd9d95710d863b. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 04:12:59.179614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Getting quotas for user 21290886e90f45f582840b785d64cd43 and project 699932c5162645f89bbd9d95710d863b. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 04:12:59.237865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 04:12:59.240004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d787cfea-b837-4be1-b060-405ca577292c',volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 04:12:59.360021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b804b4cc-21fb-466a-b8d1-3f40e015083b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.189019 Jul 28 04:12:59.360668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1160/1564] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 04:12:58 2021] POST /compute/v2.1/servers => generated 406 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:12:59.370335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-44dff8c2-bc1b-4bc8-a929-36fce21205f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:59.370956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-44dff8c2-bc1b-4bc8-a929-36fce21205f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:12:59.421706 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-44dff8c2-bc1b-4bc8-a929-36fce21205f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:59.429103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-44dff8c2-bc1b-4bc8-a929-36fce21205f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1094 microversion: 2.1 time: 0.062226 Jul 28 04:12:59.429652 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1161/1565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:12:59 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:00.446610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5f883296-1909-448c-8c1b-bb6274d9f32d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:00.447802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5f883296-1909-448c-8c1b-bb6274d9f32d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:00.453814 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5f883296-1909-448c-8c1b-bb6274d9f32d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:00.454257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5f883296-1909-448c-8c1b-bb6274d9f32d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:00.455017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5f883296-1909-448c-8c1b-bb6274d9f32d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:00.455493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5f883296-1909-448c-8c1b-bb6274d9f32d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:00.517248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5f883296-1909-448c-8c1b-bb6274d9f32d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:00.527146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5f883296-1909-448c-8c1b-bb6274d9f32d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1200 microversion: 2.1 time: 0.084156 Jul 28 04:13:00.527728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1162/1566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:00 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:01.544340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d1d8e0c4-f9e1-48c7-be35-22848bdd6f5a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:01.545002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d1d8e0c4-f9e1-48c7-be35-22848bdd6f5a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:01.551349 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d1d8e0c4-f9e1-48c7-be35-22848bdd6f5a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:01.551750 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d1d8e0c4-f9e1-48c7-be35-22848bdd6f5a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:01.552881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d1d8e0c4-f9e1-48c7-be35-22848bdd6f5a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:01.553451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d1d8e0c4-f9e1-48c7-be35-22848bdd6f5a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:01.684086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d1d8e0c4-f9e1-48c7-be35-22848bdd6f5a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:01.691984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d1d8e0c4-f9e1-48c7-be35-22848bdd6f5a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1278 microversion: 2.1 time: 0.151272 Jul 28 04:13:01.692545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1163/1567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:01 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:02.042859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-8cfe0e54-9699-4ebf-b466-3b6fe2df0813 req-a695da24-5de2-4ce2-b71a-edd3af60ac82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3a4679-ad02-41d6-9d56-5e56a98e9d88", "tag": "f7ca3e2b-1a50-41cb-b2b5-715307bf1158"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:02.045019 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:13:02.045019 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:13:02.053008 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-8cfe0e54-9699-4ebf-b466-3b6fe2df0813 req-a695da24-5de2-4ce2-b71a-edd3af60ac82 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:02.053448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-8cfe0e54-9699-4ebf-b466-3b6fe2df0813 req-a695da24-5de2-4ce2-b71a-edd3af60ac82 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:02.065098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-8cfe0e54-9699-4ebf-b466-3b6fe2df0813 req-a695da24-5de2-4ce2-b71a-edd3af60ac82 service nova] Creating event network-changed:f7ca3e2b-1a50-41cb-b2b5-715307bf1158 for instance 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 on hv-cinder-73306 Jul 28 04:13:02.072089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-8cfe0e54-9699-4ebf-b466-3b6fe2df0813 req-a695da24-5de2-4ce2-b71a-edd3af60ac82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110875 Jul 28 04:13:02.072966 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1164/1568] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:13:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:13:02.710146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e7b6eb9f-4d53-422d-aca0-8851e5a7810a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:02.710853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e7b6eb9f-4d53-422d-aca0-8851e5a7810a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:02.716891 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7b6eb9f-4d53-422d-aca0-8851e5a7810a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:02.717344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7b6eb9f-4d53-422d-aca0-8851e5a7810a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:02.718111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7b6eb9f-4d53-422d-aca0-8851e5a7810a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:02.718550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7b6eb9f-4d53-422d-aca0-8851e5a7810a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:02.839513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e7b6eb9f-4d53-422d-aca0-8851e5a7810a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:02.847301 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e7b6eb9f-4d53-422d-aca0-8851e5a7810a tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.141168 Jul 28 04:13:02.847915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1165/1569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:02 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:03.863890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3ff83c9f-b0f8-439b-92c9-73e84dd243b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:03.864583 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3ff83c9f-b0f8-439b-92c9-73e84dd243b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:03.871226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ff83c9f-b0f8-439b-92c9-73e84dd243b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:03.871682 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ff83c9f-b0f8-439b-92c9-73e84dd243b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:03.872477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ff83c9f-b0f8-439b-92c9-73e84dd243b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:03.872915 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ff83c9f-b0f8-439b-92c9-73e84dd243b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:04.006708 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3ff83c9f-b0f8-439b-92c9-73e84dd243b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:04.014406 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3ff83c9f-b0f8-439b-92c9-73e84dd243b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.154091 Jul 28 04:13:04.015040 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1166/1570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:03 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:05.030347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-23e1ea92-ea34-4b0a-a722-77bba3d6c9df tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:05.030962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-23e1ea92-ea34-4b0a-a722-77bba3d6c9df tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:05.036912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-23e1ea92-ea34-4b0a-a722-77bba3d6c9df tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:05.037363 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-23e1ea92-ea34-4b0a-a722-77bba3d6c9df tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:05.038130 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-23e1ea92-ea34-4b0a-a722-77bba3d6c9df tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:05.038571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-23e1ea92-ea34-4b0a-a722-77bba3d6c9df tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:05.157756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-23e1ea92-ea34-4b0a-a722-77bba3d6c9df tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:05.165234 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-23e1ea92-ea34-4b0a-a722-77bba3d6c9df tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.138431 Jul 28 04:13:05.165874 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1167/1571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:05 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:06.181188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bc795685-a5fd-4f6f-94d5-6215056e27e4 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:06.181797 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bc795685-a5fd-4f6f-94d5-6215056e27e4 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:06.187557 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bc795685-a5fd-4f6f-94d5-6215056e27e4 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:06.188038 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bc795685-a5fd-4f6f-94d5-6215056e27e4 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:06.188800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bc795685-a5fd-4f6f-94d5-6215056e27e4 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:06.189233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bc795685-a5fd-4f6f-94d5-6215056e27e4 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:06.308645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bc795685-a5fd-4f6f-94d5-6215056e27e4 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:06.315690 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bc795685-a5fd-4f6f-94d5-6215056e27e4 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.138151 Jul 28 04:13:06.316297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1168/1572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:06 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:07.332123 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8f5e2597-a6a5-49d3-8da1-0640faf096d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:07.332724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8f5e2597-a6a5-49d3-8da1-0640faf096d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:07.338465 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f5e2597-a6a5-49d3-8da1-0640faf096d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:07.338906 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f5e2597-a6a5-49d3-8da1-0640faf096d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:07.339654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f5e2597-a6a5-49d3-8da1-0640faf096d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:07.340108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8f5e2597-a6a5-49d3-8da1-0640faf096d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:07.462953 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8f5e2597-a6a5-49d3-8da1-0640faf096d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:07.470054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8f5e2597-a6a5-49d3-8da1-0640faf096d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.141997 Jul 28 04:13:07.470602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1169/1573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:07 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:08.486823 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a6f235ec-64cf-470c-a92b-6efe0cfacc35 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:08.487399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a6f235ec-64cf-470c-a92b-6efe0cfacc35 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:08.493662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6f235ec-64cf-470c-a92b-6efe0cfacc35 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:08.494106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6f235ec-64cf-470c-a92b-6efe0cfacc35 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:08.494854 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6f235ec-64cf-470c-a92b-6efe0cfacc35 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:08.495284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a6f235ec-64cf-470c-a92b-6efe0cfacc35 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:08.613454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a6f235ec-64cf-470c-a92b-6efe0cfacc35 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:08.620788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a6f235ec-64cf-470c-a92b-6efe0cfacc35 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.137640 Jul 28 04:13:08.621339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1170/1574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:08 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:09.637403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ce27a834-bb2b-4f78-a3a8-6635393f910b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:09.638016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ce27a834-bb2b-4f78-a3a8-6635393f910b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:09.643912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce27a834-bb2b-4f78-a3a8-6635393f910b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:09.644567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce27a834-bb2b-4f78-a3a8-6635393f910b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:09.645330 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce27a834-bb2b-4f78-a3a8-6635393f910b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:09.645765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce27a834-bb2b-4f78-a3a8-6635393f910b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:09.767281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ce27a834-bb2b-4f78-a3a8-6635393f910b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:09.775668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ce27a834-bb2b-4f78-a3a8-6635393f910b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.141852 Jul 28 04:13:09.776266 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1171/1575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:09 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:10.793083 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-aa06fc9a-deff-4c1d-864c-a5fbc3ca07f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:10.793697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-aa06fc9a-deff-4c1d-864c-a5fbc3ca07f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:10.799538 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa06fc9a-deff-4c1d-864c-a5fbc3ca07f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:10.800809 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa06fc9a-deff-4c1d-864c-a5fbc3ca07f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:10.801834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa06fc9a-deff-4c1d-864c-a5fbc3ca07f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:10.802270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-aa06fc9a-deff-4c1d-864c-a5fbc3ca07f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:10.926991 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-aa06fc9a-deff-4c1d-864c-a5fbc3ca07f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:10.932755 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-aa06fc9a-deff-4c1d-864c-a5fbc3ca07f6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.143358 Jul 28 04:13:10.933306 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1172/1576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:10 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:11.948668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2ee90fd7-5e3e-472e-86c2-94d6e3367804 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:11.949286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2ee90fd7-5e3e-472e-86c2-94d6e3367804 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:11.954996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ee90fd7-5e3e-472e-86c2-94d6e3367804 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:11.955443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ee90fd7-5e3e-472e-86c2-94d6e3367804 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:11.956729 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ee90fd7-5e3e-472e-86c2-94d6e3367804 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:11.957170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2ee90fd7-5e3e-472e-86c2-94d6e3367804 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:12.075259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2ee90fd7-5e3e-472e-86c2-94d6e3367804 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:12.082480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2ee90fd7-5e3e-472e-86c2-94d6e3367804 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.137418 Jul 28 04:13:12.083035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1173/1577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:11 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:13.100284 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-435060ca-5d31-4e56-9359-7224745e06e2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:13.100883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-435060ca-5d31-4e56-9359-7224745e06e2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:13.106678 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-435060ca-5d31-4e56-9359-7224745e06e2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:13.107127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-435060ca-5d31-4e56-9359-7224745e06e2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:13.108338 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-435060ca-5d31-4e56-9359-7224745e06e2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:13.108763 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-435060ca-5d31-4e56-9359-7224745e06e2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:13.229591 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-435060ca-5d31-4e56-9359-7224745e06e2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:13.237037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-435060ca-5d31-4e56-9359-7224745e06e2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.141362 Jul 28 04:13:13.237587 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1174/1578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:13 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:14.252760 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7c7ebd6c-5709-4f43-9351-2b9d375d0193 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:14.253360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7c7ebd6c-5709-4f43-9351-2b9d375d0193 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:14.259985 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c7ebd6c-5709-4f43-9351-2b9d375d0193 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:14.260431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c7ebd6c-5709-4f43-9351-2b9d375d0193 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:14.261182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c7ebd6c-5709-4f43-9351-2b9d375d0193 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:14.261609 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7c7ebd6c-5709-4f43-9351-2b9d375d0193 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:14.384316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7c7ebd6c-5709-4f43-9351-2b9d375d0193 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:14.391375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7c7ebd6c-5709-4f43-9351-2b9d375d0193 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.142374 Jul 28 04:13:14.392029 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1175/1579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:14 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:15.408196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-689053d2-439d-4a6e-9ea2-7fe8cce52969 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:15.408816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-689053d2-439d-4a6e-9ea2-7fe8cce52969 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:15.414924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-689053d2-439d-4a6e-9ea2-7fe8cce52969 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:15.415373 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-689053d2-439d-4a6e-9ea2-7fe8cce52969 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:15.416153 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-689053d2-439d-4a6e-9ea2-7fe8cce52969 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:15.416582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-689053d2-439d-4a6e-9ea2-7fe8cce52969 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:15.539558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-689053d2-439d-4a6e-9ea2-7fe8cce52969 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:15.546662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-689053d2-439d-4a6e-9ea2-7fe8cce52969 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.142242 Jul 28 04:13:15.547211 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1176/1580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:15 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:16.377687 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-e422595a-8d18-463d-ab46-59e617ddd386 req-ab4432b0-94e2-4d50-b0f6-1abc52f15189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3a4679-ad02-41d6-9d56-5e56a98e9d88", "name": "network-vif-plugged", "status": "completed", "tag": "f7ca3e2b-1a50-41cb-b2b5-715307bf1158"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:16.379790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:13:16.379790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:13:16.386666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-e422595a-8d18-463d-ab46-59e617ddd386 req-ab4432b0-94e2-4d50-b0f6-1abc52f15189 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:16.387111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-e422595a-8d18-463d-ab46-59e617ddd386 req-ab4432b0-94e2-4d50-b0f6-1abc52f15189 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:16.398590 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-e422595a-8d18-463d-ab46-59e617ddd386 req-ab4432b0-94e2-4d50-b0f6-1abc52f15189 service nova] Creating event network-vif-plugged:f7ca3e2b-1a50-41cb-b2b5-715307bf1158 for instance 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 on hv-cinder-73306 Jul 28 04:13:16.403562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-e422595a-8d18-463d-ab46-59e617ddd386 req-ab4432b0-94e2-4d50-b0f6-1abc52f15189 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143250 Jul 28 04:13:16.404169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1177/1581] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:13:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:16.563971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fa32d6a9-3106-4336-880c-dbfeea5bae42 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:16.564671 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fa32d6a9-3106-4336-880c-dbfeea5bae42 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:16.571479 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa32d6a9-3106-4336-880c-dbfeea5bae42 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:16.571986 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa32d6a9-3106-4336-880c-dbfeea5bae42 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:16.572779 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa32d6a9-3106-4336-880c-dbfeea5bae42 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:16.573214 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fa32d6a9-3106-4336-880c-dbfeea5bae42 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:16.691404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fa32d6a9-3106-4336-880c-dbfeea5bae42 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:16.698556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fa32d6a9-3106-4336-880c-dbfeea5bae42 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.138508 Jul 28 04:13:16.699115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1178/1582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:16 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:17.715773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-092a6a71-ae15-4f7c-b921-8f96defd308f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:17.716372 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-092a6a71-ae15-4f7c-b921-8f96defd308f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:17.722233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-092a6a71-ae15-4f7c-b921-8f96defd308f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:17.722686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-092a6a71-ae15-4f7c-b921-8f96defd308f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:17.723456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-092a6a71-ae15-4f7c-b921-8f96defd308f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:17.723922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-092a6a71-ae15-4f7c-b921-8f96defd308f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:17.845005 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-092a6a71-ae15-4f7c-b921-8f96defd308f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:17.852842 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-092a6a71-ae15-4f7c-b921-8f96defd308f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1266 microversion: 2.1 time: 0.140726 Jul 28 04:13:17.853393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1179/1583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:17 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:18.869586 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bf1e5093-9dff-4c19-aa72-0f9ad2392b7e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:18.870192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bf1e5093-9dff-4c19-aa72-0f9ad2392b7e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:18.877512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf1e5093-9dff-4c19-aa72-0f9ad2392b7e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:18.877972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf1e5093-9dff-4c19-aa72-0f9ad2392b7e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:18.879726 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf1e5093-9dff-4c19-aa72-0f9ad2392b7e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:18.880404 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf1e5093-9dff-4c19-aa72-0f9ad2392b7e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:19.000122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bf1e5093-9dff-4c19-aa72-0f9ad2392b7e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:19.008482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bf1e5093-9dff-4c19-aa72-0f9ad2392b7e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1452 microversion: 2.1 time: 0.142464 Jul 28 04:13:19.009050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1180/1584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:18 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:19.023776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c7b63a2c-1fd2-407e-9581-79f2cd789ce7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:19.024383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c7b63a2c-1fd2-407e-9581-79f2cd789ce7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:19.029946 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c7b63a2c-1fd2-407e-9581-79f2cd789ce7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:19.030393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c7b63a2c-1fd2-407e-9581-79f2cd789ce7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:19.031149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c7b63a2c-1fd2-407e-9581-79f2cd789ce7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:19.031576 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c7b63a2c-1fd2-407e-9581-79f2cd789ce7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:19.154519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c7b63a2c-1fd2-407e-9581-79f2cd789ce7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:19.162168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c7b63a2c-1fd2-407e-9581-79f2cd789ce7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1452 microversion: 2.1 time: 0.141845 Jul 28 04:13:19.162766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1181/1585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:19 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:20.961774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-efa0d130-dbd5-44ee-9180-d8aab4b29e48 req-c075cace-52df-4894-960e-ecd6a97794c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3a4679-ad02-41d6-9d56-5e56a98e9d88", "tag": "f7ca3e2b-1a50-41cb-b2b5-715307bf1158"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:20.963170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:13:20.963170 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:13:20.969845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-efa0d130-dbd5-44ee-9180-d8aab4b29e48 req-c075cace-52df-4894-960e-ecd6a97794c9 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:20.970290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-efa0d130-dbd5-44ee-9180-d8aab4b29e48 req-c075cace-52df-4894-960e-ecd6a97794c9 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:20.982190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-efa0d130-dbd5-44ee-9180-d8aab4b29e48 req-c075cace-52df-4894-960e-ecd6a97794c9 service nova] Creating event network-changed:f7ca3e2b-1a50-41cb-b2b5-715307bf1158 for instance 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 on hv-cinder-73306 Jul 28 04:13:20.988822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-efa0d130-dbd5-44ee-9180-d8aab4b29e48 req-c075cace-52df-4894-960e-ecd6a97794c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091173 Jul 28 04:13:20.989644 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1182/1586] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:13:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:13:36.999616 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e6b29fd6-f0d9-43f0-9479-0485382c688f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:37.000963 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e6b29fd6-f0d9-43f0-9479-0485382c688f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:37.011201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e6b29fd6-f0d9-43f0-9479-0485382c688f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:37.011652 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e6b29fd6-f0d9-43f0-9479-0485382c688f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:37.012622 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e6b29fd6-f0d9-43f0-9479-0485382c688f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:37.013054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e6b29fd6-f0d9-43f0-9479-0485382c688f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:37.028650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-e6b29fd6-f0d9-43f0-9479-0485382c688f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] HTTP exception thrown: Instance c0eb74a9-c89c-4863-9431-4de9be74c41c could not be found. Jul 28 04:13:37.029274 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e6b29fd6-f0d9-43f0-9479-0485382c688f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Returning 404 to user: Instance c0eb74a9-c89c-4863-9431-4de9be74c41c could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:13:37.030288 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e6b29fd6-f0d9-43f0-9479-0485382c688f tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 404 len: 111 microversion: 2.1 time: 0.034807 Jul 28 04:13:37.030851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1183/1587] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:13:36 2021] DELETE /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:37.038855 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-38282e27-c681-40b5-b27f-0e08684123ce tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:37.039647 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-38282e27-c681-40b5-b27f-0e08684123ce tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] [instance: c0eb74a9-c89c-4863-9431-4de9be74c41c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:37.052552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38282e27-c681-40b5-b27f-0e08684123ce tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:37.053003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38282e27-c681-40b5-b27f-0e08684123ce tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:37.053796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38282e27-c681-40b5-b27f-0e08684123ce tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:37.054233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-38282e27-c681-40b5-b27f-0e08684123ce tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:37.071536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-38282e27-c681-40b5-b27f-0e08684123ce tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] HTTP exception thrown: Instance c0eb74a9-c89c-4863-9431-4de9be74c41c could not be found. Jul 28 04:13:37.072438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-38282e27-c681-40b5-b27f-0e08684123ce tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] Returning 404 to user: Instance c0eb74a9-c89c-4863-9431-4de9be74c41c could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:13:37.073286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-38282e27-c681-40b5-b27f-0e08684123ce tempest-AttachVolumeTestJSON-242216195 tempest-AttachVolumeTestJSON-242216195-project] 10.222.0.16 "GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c" status: 404 len: 111 microversion: 2.1 time: 0.038099 Jul 28 04:13:37.073836 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1184/1588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:37 2021] GET /compute/v2.1/servers/c0eb74a9-c89c-4863-9431-4de9be74c41c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:13:43.799027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-20c8024b-5961-4b6f-bae7-95898a62b4d7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Action: 'create', calling method: .version_select at 0x7f68068fbe50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1032708614"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:43.817857 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-20c8024b-5961-4b6f-bae7-95898a62b4d7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Getting quotas for project 6ce504669b154dd7b2cb45a21d8b889b. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 04:13:43.821886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-20c8024b-5961-4b6f-bae7-95898a62b4d7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Getting quotas for user 8a85216c17234c099440b2e2c7934755 and project 6ce504669b154dd7b2cb45a21d8b889b. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 04:13:44.057254 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-20c8024b-5961-4b6f-bae7-95898a62b4d7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Getting quotas for project 6ce504669b154dd7b2cb45a21d8b889b. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 04:13:44.060828 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-20c8024b-5961-4b6f-bae7-95898a62b4d7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Getting quotas for user 8a85216c17234c099440b2e2c7934755 and project 6ce504669b154dd7b2cb45a21d8b889b. Resources: {'key_pairs'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 04:13:44.075023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-20c8024b-5961-4b6f-bae7-95898a62b4d7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.279823 Jul 28 04:13:44.075610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1185/1589] 10.222.0.16 () {60 vars in 1158 bytes} [Wed Jul 28 04:13:43 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:44.187161 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-205318863", "imageRef": "ddc03457-b090-49de-b88d-dd22a24df714", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1032708614", "networks": [{"uuid": "34ca3535-1601-4b82-9adf-b101cee5f398"}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:44.244896 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] validate_networks() for [('34ca3535-1601-4b82-9adf-b101cee5f398', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 04:13:44.615893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:13:44.616354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:13:44.616959 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:13:44.617401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:13:44.617816 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:13:44.626632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:44.627078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:44.627964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:44.628432 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:44.644341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Getting quotas for project 6ce504669b154dd7b2cb45a21d8b889b. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 04:13:44.648230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Getting quotas for user 8a85216c17234c099440b2e2c7934755 and project 6ce504669b154dd7b2cb45a21d8b889b. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 04:13:44.659684 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 04:13:44.662107 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc03457-b090-49de-b88d-dd22a24df714',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 04:13:44.709962 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f8726a8f-c3a8-404c-ba9f-5f8a51853ec2 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526418 Jul 28 04:13:44.710597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1186/1590] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 04:13:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:13:44.719772 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-177a9e6e-ae75-4f6f-981e-c2dd69d58928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:44.720461 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-177a9e6e-ae75-4f6f-981e-c2dd69d58928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:44.775417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-177a9e6e-ae75-4f6f-981e-c2dd69d58928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:44.782672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-177a9e6e-ae75-4f6f-981e-c2dd69d58928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1258 microversion: 2.1 time: 0.066261 Jul 28 04:13:44.783344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1187/1591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:44 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:45.808930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7ed48eb8-56e0-4c4b-a446-e3e5caec5646 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:45.809546 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7ed48eb8-56e0-4c4b-a446-e3e5caec5646 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:45.818736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ed48eb8-56e0-4c4b-a446-e3e5caec5646 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:45.819200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ed48eb8-56e0-4c4b-a446-e3e5caec5646 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:45.820017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ed48eb8-56e0-4c4b-a446-e3e5caec5646 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:45.820453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ed48eb8-56e0-4c4b-a446-e3e5caec5646 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:45.881893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7ed48eb8-56e0-4c4b-a446-e3e5caec5646 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:45.889206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7ed48eb8-56e0-4c4b-a446-e3e5caec5646 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1316 microversion: 2.1 time: 0.089113 Jul 28 04:13:45.889697 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1188/1592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:45 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1316 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:46.907064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ea2f412b-58fc-4f7a-8a8a-4c492a80f033 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:46.907922 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ea2f412b-58fc-4f7a-8a8a-4c492a80f033 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:46.914229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea2f412b-58fc-4f7a-8a8a-4c492a80f033 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:46.920556 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea2f412b-58fc-4f7a-8a8a-4c492a80f033 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:46.921635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea2f412b-58fc-4f7a-8a8a-4c492a80f033 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:46.922387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea2f412b-58fc-4f7a-8a8a-4c492a80f033 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:47.102470 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ea2f412b-58fc-4f7a-8a8a-4c492a80f033 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:47.110126 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ea2f412b-58fc-4f7a-8a8a-4c492a80f033 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.207215 Jul 28 04:13:47.110812 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1189/1593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:46 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:48.128923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4d8a85d9-f283-413c-94a9-66cad2ce7b6c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:48.129393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4d8a85d9-f283-413c-94a9-66cad2ce7b6c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:48.135331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4d8a85d9-f283-413c-94a9-66cad2ce7b6c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:48.135853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4d8a85d9-f283-413c-94a9-66cad2ce7b6c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:48.136605 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4d8a85d9-f283-413c-94a9-66cad2ce7b6c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:48.137045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4d8a85d9-f283-413c-94a9-66cad2ce7b6c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:48.544032 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4d8a85d9-f283-413c-94a9-66cad2ce7b6c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:48.552601 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4d8a85d9-f283-413c-94a9-66cad2ce7b6c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.427940 Jul 28 04:13:48.553196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1190/1594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:48 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:49.569018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-117a35fe-24d3-4827-90b2-10fb407b229a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:49.569752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-117a35fe-24d3-4827-90b2-10fb407b229a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:49.579443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-117a35fe-24d3-4827-90b2-10fb407b229a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:49.579976 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-117a35fe-24d3-4827-90b2-10fb407b229a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:49.581231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-117a35fe-24d3-4827-90b2-10fb407b229a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:49.581851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-117a35fe-24d3-4827-90b2-10fb407b229a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:49.703524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-117a35fe-24d3-4827-90b2-10fb407b229a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:49.713562 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-117a35fe-24d3-4827-90b2-10fb407b229a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.148540 Jul 28 04:13:49.714829 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1191/1595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:49 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:50.732174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-33342c65-5aec-49fd-b1d2-8c95277a6cbb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:50.733063 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-33342c65-5aec-49fd-b1d2-8c95277a6cbb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:50.739619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-33342c65-5aec-49fd-b1d2-8c95277a6cbb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:50.740087 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-33342c65-5aec-49fd-b1d2-8c95277a6cbb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:50.740848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-33342c65-5aec-49fd-b1d2-8c95277a6cbb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:50.741278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-33342c65-5aec-49fd-b1d2-8c95277a6cbb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:50.867127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-33342c65-5aec-49fd-b1d2-8c95277a6cbb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:50.879774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-33342c65-5aec-49fd-b1d2-8c95277a6cbb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.151510 Jul 28 04:13:50.880694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1192/1596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:50 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:51.896383 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5584a101-f2bf-46b5-8e5c-9feea3b3b04a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:51.897132 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5584a101-f2bf-46b5-8e5c-9feea3b3b04a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:51.902810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5584a101-f2bf-46b5-8e5c-9feea3b3b04a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:51.903259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5584a101-f2bf-46b5-8e5c-9feea3b3b04a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:51.904058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5584a101-f2bf-46b5-8e5c-9feea3b3b04a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:51.904494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5584a101-f2bf-46b5-8e5c-9feea3b3b04a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:52.043342 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5584a101-f2bf-46b5-8e5c-9feea3b3b04a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:52.054674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5584a101-f2bf-46b5-8e5c-9feea3b3b04a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.161844 Jul 28 04:13:52.055698 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1193/1597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:51 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:53.073165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3ffebce4-874a-4d89-8a36-7e429ca66797 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:53.075106 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3ffebce4-874a-4d89-8a36-7e429ca66797 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:53.083091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ffebce4-874a-4d89-8a36-7e429ca66797 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:53.083657 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ffebce4-874a-4d89-8a36-7e429ca66797 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:53.085192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ffebce4-874a-4d89-8a36-7e429ca66797 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:53.085702 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ffebce4-874a-4d89-8a36-7e429ca66797 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:53.219787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3ffebce4-874a-4d89-8a36-7e429ca66797 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:53.224227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3ffebce4-874a-4d89-8a36-7e429ca66797 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.154835 Jul 28 04:13:53.225254 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1194/1598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:53 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:54.241233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6e0fe5f9-5f4b-49ce-b21d-3b67c890c6f8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:54.241950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6e0fe5f9-5f4b-49ce-b21d-3b67c890c6f8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:54.247632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e0fe5f9-5f4b-49ce-b21d-3b67c890c6f8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:54.248296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e0fe5f9-5f4b-49ce-b21d-3b67c890c6f8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:54.249061 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e0fe5f9-5f4b-49ce-b21d-3b67c890c6f8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:54.249493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6e0fe5f9-5f4b-49ce-b21d-3b67c890c6f8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:54.376672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6e0fe5f9-5f4b-49ce-b21d-3b67c890c6f8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:54.384704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6e0fe5f9-5f4b-49ce-b21d-3b67c890c6f8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.147137 Jul 28 04:13:54.385268 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1195/1599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:54 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:55.401748 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-235314ad-65da-4fb5-8bd2-52d5e436f77d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:55.402456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-235314ad-65da-4fb5-8bd2-52d5e436f77d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:55.408226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-235314ad-65da-4fb5-8bd2-52d5e436f77d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:55.408668 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-235314ad-65da-4fb5-8bd2-52d5e436f77d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:55.409417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-235314ad-65da-4fb5-8bd2-52d5e436f77d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:55.409846 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-235314ad-65da-4fb5-8bd2-52d5e436f77d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:55.542738 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-235314ad-65da-4fb5-8bd2-52d5e436f77d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:55.550105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-235314ad-65da-4fb5-8bd2-52d5e436f77d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.152156 Jul 28 04:13:55.550658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1196/1600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:55 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:56.567428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-628af2bb-49a3-409b-b25a-c0b2e29cebd8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:56.568633 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-628af2bb-49a3-409b-b25a-c0b2e29cebd8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:56.580367 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-628af2bb-49a3-409b-b25a-c0b2e29cebd8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:56.583573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-628af2bb-49a3-409b-b25a-c0b2e29cebd8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:56.586187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-628af2bb-49a3-409b-b25a-c0b2e29cebd8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:56.586853 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-628af2bb-49a3-409b-b25a-c0b2e29cebd8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:56.733653 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-628af2bb-49a3-409b-b25a-c0b2e29cebd8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:56.741974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-628af2bb-49a3-409b-b25a-c0b2e29cebd8 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.178298 Jul 28 04:13:56.743346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1197/1601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:56 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:57.758773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-046ac6d7-9eda-40ef-9ca1-592848f54d3e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:57.759405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-046ac6d7-9eda-40ef-9ca1-592848f54d3e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:57.765429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-046ac6d7-9eda-40ef-9ca1-592848f54d3e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:57.765667 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-046ac6d7-9eda-40ef-9ca1-592848f54d3e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:57.766660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-046ac6d7-9eda-40ef-9ca1-592848f54d3e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:57.767110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-046ac6d7-9eda-40ef-9ca1-592848f54d3e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:57.891355 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-046ac6d7-9eda-40ef-9ca1-592848f54d3e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:57.899289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-046ac6d7-9eda-40ef-9ca1-592848f54d3e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.144741 Jul 28 04:13:57.899968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1198/1602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:57 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:58.916661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-25db0971-4937-48cf-a1d5-63b28a345249 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:58.917279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-25db0971-4937-48cf-a1d5-63b28a345249 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:13:58.923507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25db0971-4937-48cf-a1d5-63b28a345249 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:58.924001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25db0971-4937-48cf-a1d5-63b28a345249 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:58.924852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25db0971-4937-48cf-a1d5-63b28a345249 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:58.925290 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-25db0971-4937-48cf-a1d5-63b28a345249 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:59.068786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-25db0971-4937-48cf-a1d5-63b28a345249 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:59.077094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-25db0971-4937-48cf-a1d5-63b28a345249 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.164016 Jul 28 04:13:59.080892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1199/1603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:13:58 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:59.188619 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-5eb26736-75b9-4c28-a7f4-58fc21338b48 req-07b33141-926e-4ae6-87e4-4708f748ee9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f6dd1e-63fa-47d5-a20c-ab7c80534b5c", "tag": "f36bc118-6ca3-4be9-8638-9c6343d7762b"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:59.192937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:13:59.192937 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:13:59.200365 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5eb26736-75b9-4c28-a7f4-58fc21338b48 req-07b33141-926e-4ae6-87e4-4708f748ee9b service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:13:59.200987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-5eb26736-75b9-4c28-a7f4-58fc21338b48 req-07b33141-926e-4ae6-87e4-4708f748ee9b service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:13:59.213379 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-5eb26736-75b9-4c28-a7f4-58fc21338b48 req-07b33141-926e-4ae6-87e4-4708f748ee9b service nova] Creating event network-changed:f36bc118-6ca3-4be9-8638-9c6343d7762b for instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c on hv-cinder-73306 Jul 28 04:13:59.219019 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-5eb26736-75b9-4c28-a7f4-58fc21338b48 req-07b33141-926e-4ae6-87e4-4708f748ee9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043092 Jul 28 04:13:59.220358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1200/1604] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:13:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:14:00.094956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eb033516-29e8-4882-a65f-303a9b2f725b tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:00.095669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eb033516-29e8-4882-a65f-303a9b2f725b tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:00.103276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb033516-29e8-4882-a65f-303a9b2f725b tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:00.103758 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb033516-29e8-4882-a65f-303a9b2f725b tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:00.104547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb033516-29e8-4882-a65f-303a9b2f725b tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:00.104987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eb033516-29e8-4882-a65f-303a9b2f725b tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:00.283589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eb033516-29e8-4882-a65f-303a9b2f725b tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:00.292049 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eb033516-29e8-4882-a65f-303a9b2f725b tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.201277 Jul 28 04:14:00.292614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1201/1605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:00 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:01.308554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bbba09a3-9cdf-49fe-a1a9-75613f8c5504 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:01.309163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bbba09a3-9cdf-49fe-a1a9-75613f8c5504 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:01.314892 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbba09a3-9cdf-49fe-a1a9-75613f8c5504 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:01.315329 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbba09a3-9cdf-49fe-a1a9-75613f8c5504 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:01.316113 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbba09a3-9cdf-49fe-a1a9-75613f8c5504 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:01.316539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bbba09a3-9cdf-49fe-a1a9-75613f8c5504 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:01.436740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bbba09a3-9cdf-49fe-a1a9-75613f8c5504 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:01.444369 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bbba09a3-9cdf-49fe-a1a9-75613f8c5504 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.139532 Jul 28 04:14:01.444924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1202/1606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:01 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:02.461335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-48fd9a8c-1c1b-4fc7-9ecc-a37f46f49fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:02.461960 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-48fd9a8c-1c1b-4fc7-9ecc-a37f46f49fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:02.467775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-48fd9a8c-1c1b-4fc7-9ecc-a37f46f49fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:02.468231 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-48fd9a8c-1c1b-4fc7-9ecc-a37f46f49fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:02.468998 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-48fd9a8c-1c1b-4fc7-9ecc-a37f46f49fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:02.469439 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-48fd9a8c-1c1b-4fc7-9ecc-a37f46f49fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:02.593877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-48fd9a8c-1c1b-4fc7-9ecc-a37f46f49fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:02.601195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-48fd9a8c-1c1b-4fc7-9ecc-a37f46f49fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.144257 Jul 28 04:14:02.601756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1203/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:02 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:03.617952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-bf6d1681-1890-430f-91d1-18acb659677d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:03.618608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-bf6d1681-1890-430f-91d1-18acb659677d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:03.628654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf6d1681-1890-430f-91d1-18acb659677d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:03.629103 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf6d1681-1890-430f-91d1-18acb659677d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:03.629956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf6d1681-1890-430f-91d1-18acb659677d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:03.630547 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-bf6d1681-1890-430f-91d1-18acb659677d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:03.753861 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-bf6d1681-1890-430f-91d1-18acb659677d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:03.761451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-bf6d1681-1890-430f-91d1-18acb659677d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.147906 Jul 28 04:14:03.761994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1204/1608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:03 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:04.778826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ea1d56b6-454c-4709-8b3f-02920af87eeb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:04.779443 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ea1d56b6-454c-4709-8b3f-02920af87eeb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:04.785203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea1d56b6-454c-4709-8b3f-02920af87eeb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:04.785654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea1d56b6-454c-4709-8b3f-02920af87eeb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:04.786414 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea1d56b6-454c-4709-8b3f-02920af87eeb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:04.786850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ea1d56b6-454c-4709-8b3f-02920af87eeb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:04.903378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ea1d56b6-454c-4709-8b3f-02920af87eeb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:04.910533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ea1d56b6-454c-4709-8b3f-02920af87eeb tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.135339 Jul 28 04:14:04.911091 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1205/1609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:04 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:05.927945 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9501e639-7a5b-4985-905e-b3ef798f68af tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:05.928615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9501e639-7a5b-4985-905e-b3ef798f68af tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:05.934384 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9501e639-7a5b-4985-905e-b3ef798f68af tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:05.934830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9501e639-7a5b-4985-905e-b3ef798f68af tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:05.935588 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9501e639-7a5b-4985-905e-b3ef798f68af tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:05.936054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9501e639-7a5b-4985-905e-b3ef798f68af tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:06.057192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9501e639-7a5b-4985-905e-b3ef798f68af tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:06.064277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9501e639-7a5b-4985-905e-b3ef798f68af tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.140057 Jul 28 04:14:06.064848 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1206/1610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:05 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:06.639441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-fbf07e97-0095-44dc-aa77-7ebd05dd70c2 req-0bbf5d95-a9c4-4de2-9c6a-5786b7cf9391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f6dd1e-63fa-47d5-a20c-ab7c80534b5c", "name": "network-vif-plugged", "status": "completed", "tag": "f36bc118-6ca3-4be9-8638-9c6343d7762b"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:06.641118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:14:06.641118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:14:06.649243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-fbf07e97-0095-44dc-aa77-7ebd05dd70c2 req-0bbf5d95-a9c4-4de2-9c6a-5786b7cf9391 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:06.649694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-fbf07e97-0095-44dc-aa77-7ebd05dd70c2 req-0bbf5d95-a9c4-4de2-9c6a-5786b7cf9391 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:06.660845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-fbf07e97-0095-44dc-aa77-7ebd05dd70c2 req-0bbf5d95-a9c4-4de2-9c6a-5786b7cf9391 service nova] Creating event network-vif-plugged:f36bc118-6ca3-4be9-8638-9c6343d7762b for instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c on hv-cinder-73306 Jul 28 04:14:06.666453 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-fbf07e97-0095-44dc-aa77-7ebd05dd70c2 req-0bbf5d95-a9c4-4de2-9c6a-5786b7cf9391 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030562 Jul 28 04:14:06.667031 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1207/1611] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:14:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:14:07.082393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e04dab27-2434-4b02-81fe-e788729d5af4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:07.083017 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e04dab27-2434-4b02-81fe-e788729d5af4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:07.089612 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e04dab27-2434-4b02-81fe-e788729d5af4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:07.090060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e04dab27-2434-4b02-81fe-e788729d5af4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:07.090815 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e04dab27-2434-4b02-81fe-e788729d5af4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:07.091249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e04dab27-2434-4b02-81fe-e788729d5af4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:07.207903 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e04dab27-2434-4b02-81fe-e788729d5af4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:07.215949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e04dab27-2434-4b02-81fe-e788729d5af4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.137582 Jul 28 04:14:07.216508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1208/1612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:07 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:08.232905 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7937d888-a0a0-42c1-8308-7b3d93ff50d3 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:08.233516 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7937d888-a0a0-42c1-8308-7b3d93ff50d3 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:08.239316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7937d888-a0a0-42c1-8308-7b3d93ff50d3 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:08.239796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7937d888-a0a0-42c1-8308-7b3d93ff50d3 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:08.240565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7937d888-a0a0-42c1-8308-7b3d93ff50d3 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:08.241226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7937d888-a0a0-42c1-8308-7b3d93ff50d3 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:08.364690 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7937d888-a0a0-42c1-8308-7b3d93ff50d3 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:08.372474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7937d888-a0a0-42c1-8308-7b3d93ff50d3 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1358 microversion: 2.1 time: 0.143519 Jul 28 04:14:08.373026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1209/1613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:08 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:09.388988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a100e320-7b0d-403c-955f-e2be738a7a68 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:09.389578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a100e320-7b0d-403c-955f-e2be738a7a68 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:09.395310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a100e320-7b0d-403c-955f-e2be738a7a68 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:09.395787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a100e320-7b0d-403c-955f-e2be738a7a68 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:09.396550 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a100e320-7b0d-403c-955f-e2be738a7a68 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:09.397597 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a100e320-7b0d-403c-955f-e2be738a7a68 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:09.516187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a100e320-7b0d-403c-955f-e2be738a7a68 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:09.523994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a100e320-7b0d-403c-955f-e2be738a7a68 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1549 microversion: 2.1 time: 0.138734 Jul 28 04:14:09.524560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1210/1614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:09 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1549 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:09.539398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6c1112b4-5afa-4bdf-ae89-a0deeef95928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:09.540043 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6c1112b4-5afa-4bdf-ae89-a0deeef95928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:09.545728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6c1112b4-5afa-4bdf-ae89-a0deeef95928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:09.546184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6c1112b4-5afa-4bdf-ae89-a0deeef95928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:09.546950 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6c1112b4-5afa-4bdf-ae89-a0deeef95928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:09.547392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6c1112b4-5afa-4bdf-ae89-a0deeef95928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:09.668072 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6c1112b4-5afa-4bdf-ae89-a0deeef95928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:09.675187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6c1112b4-5afa-4bdf-ae89-a0deeef95928 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1549 microversion: 2.1 time: 0.139330 Jul 28 04:14:09.675767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1211/1615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:09 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1549 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:09.690390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-53ce290f-35d6-4ad5-8169-0ccb681ea0de tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:09.693618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:14:09.693618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:14:09.695276 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-53ce290f-35d6-4ad5-8169-0ccb681ea0de tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:09.696051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-53ce290f-35d6-4ad5-8169-0ccb681ea0de tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Searching by: {'deleted': False, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b'} {{(pid=119154) get_all /opt/stack/nova/nova/compute/api.py:2833}} Jul 28 04:14:09.702252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53ce290f-35d6-4ad5-8169-0ccb681ea0de tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:09.702699 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53ce290f-35d6-4ad5-8169-0ccb681ea0de tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:09.703498 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53ce290f-35d6-4ad5-8169-0ccb681ea0de tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:09.703964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-53ce290f-35d6-4ad5-8169-0ccb681ea0de tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:09.793594 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.multi_cell_list [None req-53ce290f-35d6-4ad5-8169-0ccb681ea0de tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119154) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jul 28 04:14:09.891654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-53ce290f-35d6-4ad5-8169-0ccb681ea0de tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204438 Jul 28 04:14:09.892292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1212/1616] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Jul 28 04:14:09 2021] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:14:09.902631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-51179e36-e25f-4c60-9696-5a1530f48980 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:09.903293 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-51179e36-e25f-4c60-9696-5a1530f48980 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:09.909168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-51179e36-e25f-4c60-9696-5a1530f48980 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:09.909641 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-51179e36-e25f-4c60-9696-5a1530f48980 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:09.910451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-51179e36-e25f-4c60-9696-5a1530f48980 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:09.910912 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-51179e36-e25f-4c60-9696-5a1530f48980 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:10.042831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-51179e36-e25f-4c60-9696-5a1530f48980 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:10.050010 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-51179e36-e25f-4c60-9696-5a1530f48980 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1549 microversion: 2.1 time: 0.150837 Jul 28 04:14:10.050568 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1213/1617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:09 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:13.661833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fbefe57a-d234-4bd3-ba2a-6f750f5b5e7f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c783b457-c267-4ed4-a70f-f2484965c800"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:13.664000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fbefe57a-d234-4bd3-ba2a-6f750f5b5e7f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:13.669768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fbefe57a-d234-4bd3-ba2a-6f750f5b5e7f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:13.670213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fbefe57a-d234-4bd3-ba2a-6f750f5b5e7f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:13.670964 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fbefe57a-d234-4bd3-ba2a-6f750f5b5e7f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:13.671398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fbefe57a-d234-4bd3-ba2a-6f750f5b5e7f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:13.915265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fbefe57a-d234-4bd3-ba2a-6f750f5b5e7f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "POST /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256964 Jul 28 04:14:13.915939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1214/1618] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Jul 28 04:14:13 2021] POST /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:14:21.474128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-03cacfb3-2097-40a4-8f8d-40f2ce3626cd tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:21.474860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-03cacfb3-2097-40a4-8f8d-40f2ce3626cd tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:21.481813 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03cacfb3-2097-40a4-8f8d-40f2ce3626cd tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:21.482279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03cacfb3-2097-40a4-8f8d-40f2ce3626cd tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:21.483267 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03cacfb3-2097-40a4-8f8d-40f2ce3626cd tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:21.483694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-03cacfb3-2097-40a4-8f8d-40f2ce3626cd tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:21.602584 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-03cacfb3-2097-40a4-8f8d-40f2ce3626cd tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:21.610400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-03cacfb3-2097-40a4-8f8d-40f2ce3626cd tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1595 microversion: 2.1 time: 0.140653 Jul 28 04:14:21.610952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1215/1619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:21 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1595 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:23.337814 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-aa03cd74-f9b4-4aae-b058-64382e9f3189 req-f9d0a314-ed64-4228-9531-59478fef64cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f6dd1e-63fa-47d5-a20c-ab7c80534b5c", "tag": "f36bc118-6ca3-4be9-8638-9c6343d7762b"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:23.340297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:14:23.340297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:14:23.347650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-aa03cd74-f9b4-4aae-b058-64382e9f3189 req-f9d0a314-ed64-4228-9531-59478fef64cc service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:23.348338 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-aa03cd74-f9b4-4aae-b058-64382e9f3189 req-f9d0a314-ed64-4228-9531-59478fef64cc service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:23.362133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-aa03cd74-f9b4-4aae-b058-64382e9f3189 req-f9d0a314-ed64-4228-9531-59478fef64cc service nova] Creating event network-changed:f36bc118-6ca3-4be9-8638-9c6343d7762b for instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c on hv-cinder-73306 Jul 28 04:14:23.368398 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-aa03cd74-f9b4-4aae-b058-64382e9f3189 req-f9d0a314-ed64-4228-9531-59478fef64cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034228 Jul 28 04:14:23.369429 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1216/1620] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:14:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:24.551314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-26016679-c694-4897-af64-c453fc148bc4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-911483751"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:24.552172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-26016679-c694-4897-af64-c453fc148bc4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:24.558354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26016679-c694-4897-af64-c453fc148bc4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:24.558806 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26016679-c694-4897-af64-c453fc148bc4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:24.559572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26016679-c694-4897-af64-c453fc148bc4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:24.560033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26016679-c694-4897-af64-c453fc148bc4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:24.679582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.network.security_group_api [None req-26016679-c694-4897-af64-c453fc148bc4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Adding security group a863edcc-de8b-4856-9ed4-794d026fc013 to port f36bc118-6ca3-4be9-8638-9c6343d7762b Jul 28 04:14:25.014102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-26016679-c694-4897-af64-c453fc148bc4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "POST /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.467141 Jul 28 04:14:25.015299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1217/1621] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 04:14:24 2021] POST /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:14:25.023116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8eec7be4-f3a3-41ab-8bd0-d130295d9670 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:25.028455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8eec7be4-f3a3-41ab-8bd0-d130295d9670 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:25.046263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8eec7be4-f3a3-41ab-8bd0-d130295d9670 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:25.046880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8eec7be4-f3a3-41ab-8bd0-d130295d9670 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:25.047688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8eec7be4-f3a3-41ab-8bd0-d130295d9670 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:25.048242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8eec7be4-f3a3-41ab-8bd0-d130295d9670 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:25.205098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8eec7be4-f3a3-41ab-8bd0-d130295d9670 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:25.215797 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8eec7be4-f3a3-41ab-8bd0-d130295d9670 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1759 microversion: 2.1 time: 0.196759 Jul 28 04:14:25.216417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1218/1622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:25 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1759 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:25.385669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-1923e42f-f607-4cb1-926d-f83c8314a18a req-9f1b8045-0b81-4349-a671-6174e2ac2dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f6dd1e-63fa-47d5-a20c-ab7c80534b5c", "tag": "f36bc118-6ca3-4be9-8638-9c6343d7762b"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:25.387237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:14:25.387237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:14:25.394225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-1923e42f-f607-4cb1-926d-f83c8314a18a req-9f1b8045-0b81-4349-a671-6174e2ac2dd8 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:25.394674 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-1923e42f-f607-4cb1-926d-f83c8314a18a req-9f1b8045-0b81-4349-a671-6174e2ac2dd8 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:25.406237 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-1923e42f-f607-4cb1-926d-f83c8314a18a req-9f1b8045-0b81-4349-a671-6174e2ac2dd8 service nova] Creating event network-changed:f36bc118-6ca3-4be9-8638-9c6343d7762b for instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c on hv-cinder-73306 Jul 28 04:14:25.411108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-1923e42f-f607-4cb1-926d-f83c8314a18a req-9f1b8045-0b81-4349-a671-6174e2ac2dd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029665 Jul 28 04:14:25.414540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1219/1623] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:14:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:14:41.457212 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1937792807", "imageRef": "619eac49-0431-48f6-8d6c-6ba6806fa755", "flavorRef": "452"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:41.511117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] validate_networks() for None {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 04:14:41.778122 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:14:41.778548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:14:41.779027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:14:41.779441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:14:41.779900 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:14:41.789044 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:41.789495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:41.790326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:41.790764 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:41.807798 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Getting quotas for project e9e78a86e18c4df3b6a1e756fa51fc10. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 04:14:41.811615 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Getting quotas for user ae1a5c628b764cf48b6bb85dd1f1c831 and project e9e78a86e18c4df3b6a1e756fa51fc10. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 04:14:41.822074 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 04:14:41.824455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='619eac49-0431-48f6-8d6c-6ba6806fa755',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 04:14:41.868456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-73a85c53-b271-4abc-b302-c5aec2e0d3f5 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.415637 Jul 28 04:14:41.869099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1220/1624] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 04:14:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:14:41.878308 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a4ff24cd-9257-4d1c-a5eb-81f1de32c2e7 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:41.878921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a4ff24cd-9257-4d1c-a5eb-81f1de32c2e7 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:41.931024 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a4ff24cd-9257-4d1c-a5eb-81f1de32c2e7 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:41.938243 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a4ff24cd-9257-4d1c-a5eb-81f1de32c2e7 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1215 microversion: 2.1 time: 0.063295 Jul 28 04:14:41.938786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1221/1625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:41 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:42.954864 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-88aebe74-109b-432e-b415-b9622fff8b37 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:42.955493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-88aebe74-109b-432e-b415-b9622fff8b37 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:42.962192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88aebe74-109b-432e-b415-b9622fff8b37 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:42.962648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88aebe74-109b-432e-b415-b9622fff8b37 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:42.963415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88aebe74-109b-432e-b415-b9622fff8b37 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:42.963876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-88aebe74-109b-432e-b415-b9622fff8b37 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:43.055574 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-88aebe74-109b-432e-b415-b9622fff8b37 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:43.062717 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-88aebe74-109b-432e-b415-b9622fff8b37 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1273 microversion: 2.1 time: 0.111527 Jul 28 04:14:43.063277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1222/1626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:42 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:44.080378 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-06f85db5-c399-4c9e-ae03-3a93ed7c5fde tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:44.081139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-06f85db5-c399-4c9e-ae03-3a93ed7c5fde tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:44.088766 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06f85db5-c399-4c9e-ae03-3a93ed7c5fde tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:44.089316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06f85db5-c399-4c9e-ae03-3a93ed7c5fde tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:44.090188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06f85db5-c399-4c9e-ae03-3a93ed7c5fde tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:44.090693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-06f85db5-c399-4c9e-ae03-3a93ed7c5fde tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:44.295361 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-06f85db5-c399-4c9e-ae03-3a93ed7c5fde tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:44.304357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-06f85db5-c399-4c9e-ae03-3a93ed7c5fde tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1315 microversion: 2.1 time: 0.227490 Jul 28 04:14:44.305056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1223/1627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:44 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:44.342061 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-675e9b5e-1586-4d82-b2ec-e563d8e9a2e1 req-94bcf1ae-7a0e-447b-b2e2-69ffbd7d02e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6f0e96-cfbc-4c23-b813-fd8771e5786b", "tag": "86354c62-042b-4b92-98e0-ec7698d2a068"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:44.343914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:14:44.343914 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:14:44.352961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-675e9b5e-1586-4d82-b2ec-e563d8e9a2e1 req-94bcf1ae-7a0e-447b-b2e2-69ffbd7d02e0 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:44.353731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-675e9b5e-1586-4d82-b2ec-e563d8e9a2e1 req-94bcf1ae-7a0e-447b-b2e2-69ffbd7d02e0 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:44.368060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-675e9b5e-1586-4d82-b2ec-e563d8e9a2e1 req-94bcf1ae-7a0e-447b-b2e2-69ffbd7d02e0 service nova] Creating event network-changed:86354c62-042b-4b92-98e0-ec7698d2a068 for instance 8e6f0e96-cfbc-4c23-b813-fd8771e5786b on hv-cinder-73306 Jul 28 04:14:44.373901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-675e9b5e-1586-4d82-b2ec-e563d8e9a2e1 req-94bcf1ae-7a0e-447b-b2e2-69ffbd7d02e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036170 Jul 28 04:14:44.374681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1224/1628] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:14:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:45.321344 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b81c627b-9b07-476a-9e47-c5eb1eeabc3f tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:45.322050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b81c627b-9b07-476a-9e47-c5eb1eeabc3f tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:45.327957 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b81c627b-9b07-476a-9e47-c5eb1eeabc3f tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:45.328407 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b81c627b-9b07-476a-9e47-c5eb1eeabc3f tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:45.329172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b81c627b-9b07-476a-9e47-c5eb1eeabc3f tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:45.329606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b81c627b-9b07-476a-9e47-c5eb1eeabc3f tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:45.450492 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b81c627b-9b07-476a-9e47-c5eb1eeabc3f tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:45.457539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b81c627b-9b07-476a-9e47-c5eb1eeabc3f tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1315 microversion: 2.1 time: 0.140539 Jul 28 04:14:45.458086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1225/1629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:45 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:46.473889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f7f32f66-687d-4642-87ff-56f2310db0db tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:46.474496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f7f32f66-687d-4642-87ff-56f2310db0db tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:46.480390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7f32f66-687d-4642-87ff-56f2310db0db tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:46.480841 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7f32f66-687d-4642-87ff-56f2310db0db tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:46.481596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7f32f66-687d-4642-87ff-56f2310db0db tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:46.482030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f7f32f66-687d-4642-87ff-56f2310db0db tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:46.604602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f7f32f66-687d-4642-87ff-56f2310db0db tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:46.611888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f7f32f66-687d-4642-87ff-56f2310db0db tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1315 microversion: 2.1 time: 0.141673 Jul 28 04:14:46.612468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1226/1630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:46 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:47.628454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a34002e0-5dda-4738-b47e-067d921e741d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:47.629061 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a34002e0-5dda-4738-b47e-067d921e741d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:47.635851 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a34002e0-5dda-4738-b47e-067d921e741d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:47.636297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a34002e0-5dda-4738-b47e-067d921e741d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:47.637050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a34002e0-5dda-4738-b47e-067d921e741d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:47.637480 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a34002e0-5dda-4738-b47e-067d921e741d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:47.758789 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-a34002e0-5dda-4738-b47e-067d921e741d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:47.765949 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a34002e0-5dda-4738-b47e-067d921e741d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1315 microversion: 2.1 time: 0.141115 Jul 28 04:14:47.766513 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1227/1631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:47 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:47.843481 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-40f50496-e755-4d9b-9234-54dbaf5f4a79 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:47.844424 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-40f50496-e755-4d9b-9234-54dbaf5f4a79 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:47.850279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-40f50496-e755-4d9b-9234-54dbaf5f4a79 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:47.851279 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-40f50496-e755-4d9b-9234-54dbaf5f4a79 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:47.852138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-40f50496-e755-4d9b-9234-54dbaf5f4a79 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:47.852575 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-40f50496-e755-4d9b-9234-54dbaf5f4a79 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:47.920875 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-40f50496-e755-4d9b-9234-54dbaf5f4a79 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "POST /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.080904 Jul 28 04:14:47.921499 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1228/1632] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 04:14:47 2021] POST /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:14:47.930050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b289645c-9299-40f9-9e69-b4fd84fb2939 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:47.930744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b289645c-9299-40f9-9e69-b4fd84fb2939 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:47.936703 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b289645c-9299-40f9-9e69-b4fd84fb2939 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:47.937139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b289645c-9299-40f9-9e69-b4fd84fb2939 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:47.938044 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b289645c-9299-40f9-9e69-b4fd84fb2939 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:47.938617 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b289645c-9299-40f9-9e69-b4fd84fb2939 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:48.113504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b289645c-9299-40f9-9e69-b4fd84fb2939 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:48.128300 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b289645c-9299-40f9-9e69-b4fd84fb2939 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1751 microversion: 2.1 time: 0.202489 Jul 28 04:14:48.129167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1229/1633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:47 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:48.782549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4ceedc91-7b20-49ec-94db-66a84756abcc tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:48.783154 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4ceedc91-7b20-49ec-94db-66a84756abcc tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:48.789392 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ceedc91-7b20-49ec-94db-66a84756abcc tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:48.789835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ceedc91-7b20-49ec-94db-66a84756abcc tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:48.790585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ceedc91-7b20-49ec-94db-66a84756abcc tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:48.791016 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ceedc91-7b20-49ec-94db-66a84756abcc tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:48.910636 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4ceedc91-7b20-49ec-94db-66a84756abcc tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:48.917744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4ceedc91-7b20-49ec-94db-66a84756abcc tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1315 microversion: 2.1 time: 0.138794 Jul 28 04:14:48.918306 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1230/1634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:48 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:49.145709 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fb75661a-32dc-45cf-a59a-582ddaa0baf6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:49.146325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fb75661a-32dc-45cf-a59a-582ddaa0baf6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:49.152134 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb75661a-32dc-45cf-a59a-582ddaa0baf6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:49.152582 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb75661a-32dc-45cf-a59a-582ddaa0baf6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:49.153346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb75661a-32dc-45cf-a59a-582ddaa0baf6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:49.153786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fb75661a-32dc-45cf-a59a-582ddaa0baf6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:49.276719 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-fb75661a-32dc-45cf-a59a-582ddaa0baf6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:49.284348 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fb75661a-32dc-45cf-a59a-582ddaa0baf6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.142384 Jul 28 04:14:49.284903 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1231/1635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:49 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:49.754466 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-28c45347-f759-40ad-8f82-4d42ac3441fb req-856fe45e-4d14-4c6d-995e-27bbbdfd5286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6f0e96-cfbc-4c23-b813-fd8771e5786b", "name": "network-vif-plugged", "status": "completed", "tag": "86354c62-042b-4b92-98e0-ec7698d2a068"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:49.756139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:14:49.756139 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:14:49.763348 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-28c45347-f759-40ad-8f82-4d42ac3441fb req-856fe45e-4d14-4c6d-995e-27bbbdfd5286 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:49.763817 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-28c45347-f759-40ad-8f82-4d42ac3441fb req-856fe45e-4d14-4c6d-995e-27bbbdfd5286 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:49.775464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-28c45347-f759-40ad-8f82-4d42ac3441fb req-856fe45e-4d14-4c6d-995e-27bbbdfd5286 service nova] Creating event network-vif-plugged:86354c62-042b-4b92-98e0-ec7698d2a068 for instance 8e6f0e96-cfbc-4c23-b813-fd8771e5786b on hv-cinder-73306 Jul 28 04:14:49.780145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-28c45347-f759-40ad-8f82-4d42ac3441fb req-856fe45e-4d14-4c6d-995e-27bbbdfd5286 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029292 Jul 28 04:14:49.780731 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1232/1636] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:14:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:14:49.934765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-1599123d-840a-4ef2-af6c-b95b7d3df062 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:49.935388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-1599123d-840a-4ef2-af6c-b95b7d3df062 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:49.941399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1599123d-840a-4ef2-af6c-b95b7d3df062 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:49.941852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1599123d-840a-4ef2-af6c-b95b7d3df062 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:49.942618 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1599123d-840a-4ef2-af6c-b95b7d3df062 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:49.943054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-1599123d-840a-4ef2-af6c-b95b7d3df062 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:50.092366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-1599123d-840a-4ef2-af6c-b95b7d3df062 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:50.099493 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-1599123d-840a-4ef2-af6c-b95b7d3df062 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1315 microversion: 2.1 time: 0.168844 Jul 28 04:14:50.100076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1233/1637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:49 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:50.302390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c2643bfe-4a2d-4077-9438-d94ae623765f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:50.302930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c2643bfe-4a2d-4077-9438-d94ae623765f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:50.308924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2643bfe-4a2d-4077-9438-d94ae623765f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:50.309373 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2643bfe-4a2d-4077-9438-d94ae623765f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:50.310127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2643bfe-4a2d-4077-9438-d94ae623765f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:50.310560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c2643bfe-4a2d-4077-9438-d94ae623765f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:50.430751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-c2643bfe-4a2d-4077-9438-d94ae623765f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:50.438402 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c2643bfe-4a2d-4077-9438-d94ae623765f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.139755 Jul 28 04:14:50.438954 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1234/1638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:50 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:51.117422 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-403a39cb-0296-46e6-9d09-04f3d117af1e tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:51.118054 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-403a39cb-0296-46e6-9d09-04f3d117af1e tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:51.123955 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-403a39cb-0296-46e6-9d09-04f3d117af1e tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:51.125000 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-403a39cb-0296-46e6-9d09-04f3d117af1e tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:51.125638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-403a39cb-0296-46e6-9d09-04f3d117af1e tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:51.125638 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-403a39cb-0296-46e6-9d09-04f3d117af1e tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:51.247297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-403a39cb-0296-46e6-9d09-04f3d117af1e tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:51.254399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-403a39cb-0296-46e6-9d09-04f3d117af1e tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1315 microversion: 2.1 time: 0.141224 Jul 28 04:14:51.254956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1235/1639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:51 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:51.456318 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dba02fbe-e908-435a-a691-76529aa64a31 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:51.456852 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dba02fbe-e908-435a-a691-76529aa64a31 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:51.463186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dba02fbe-e908-435a-a691-76529aa64a31 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:51.463635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dba02fbe-e908-435a-a691-76529aa64a31 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:51.464423 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dba02fbe-e908-435a-a691-76529aa64a31 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:51.464860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dba02fbe-e908-435a-a691-76529aa64a31 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:51.588773 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dba02fbe-e908-435a-a691-76529aa64a31 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:51.596434 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dba02fbe-e908-435a-a691-76529aa64a31 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.143790 Jul 28 04:14:51.596994 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1236/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:51 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:52.270114 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-99ed0cf4-24a0-40fa-8b22-3f53fc36f0cb tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:52.270717 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-99ed0cf4-24a0-40fa-8b22-3f53fc36f0cb tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:52.277235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99ed0cf4-24a0-40fa-8b22-3f53fc36f0cb tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:52.277681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99ed0cf4-24a0-40fa-8b22-3f53fc36f0cb tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:52.278437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99ed0cf4-24a0-40fa-8b22-3f53fc36f0cb tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:52.278870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-99ed0cf4-24a0-40fa-8b22-3f53fc36f0cb tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:52.398688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-99ed0cf4-24a0-40fa-8b22-3f53fc36f0cb tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:52.405877 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-99ed0cf4-24a0-40fa-8b22-3f53fc36f0cb tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1465 microversion: 2.1 time: 0.139376 Jul 28 04:14:52.406438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1237/1641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:52 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1465 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:52.442196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-a320a8fb-63b2-466d-8e94-a04267e289f0 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:52.442196 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a320a8fb-63b2-466d-8e94-a04267e289f0 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:52.448146 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a320a8fb-63b2-466d-8e94-a04267e289f0 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:52.448630 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a320a8fb-63b2-466d-8e94-a04267e289f0 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:52.449399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a320a8fb-63b2-466d-8e94-a04267e289f0 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:52.449834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-a320a8fb-63b2-466d-8e94-a04267e289f0 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:52.474068 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-a320a8fb-63b2-466d-8e94-a04267e289f0 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 04:14:52.545426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-a320a8fb-63b2-466d-8e94-a04267e289f0 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 204 len: 0 microversion: 2.1 time: 0.107819 Jul 28 04:14:52.546197 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1238/1642] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:14:52 2021] DELETE /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:14:52.554535 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2560566f-09bd-4d86-a5db-09d3e52f8740 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:52.555236 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2560566f-09bd-4d86-a5db-09d3e52f8740 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:52.560974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2560566f-09bd-4d86-a5db-09d3e52f8740 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:52.561421 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2560566f-09bd-4d86-a5db-09d3e52f8740 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:52.562187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2560566f-09bd-4d86-a5db-09d3e52f8740 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:52.562624 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2560566f-09bd-4d86-a5db-09d3e52f8740 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:52.685810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2560566f-09bd-4d86-a5db-09d3e52f8740 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:52.692984 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2560566f-09bd-4d86-a5db-09d3e52f8740 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1471 microversion: 2.1 time: 0.142500 Jul 28 04:14:52.693536 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1239/1643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:52 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1471 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:52.698788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-be7df9a0-2425-4bbf-857b-b000a4129a86 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:52.699386 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-be7df9a0-2425-4bbf-857b-b000a4129a86 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:52.704888 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-be7df9a0-2425-4bbf-857b-b000a4129a86 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:52.705330 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-be7df9a0-2425-4bbf-857b-b000a4129a86 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:52.706116 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-be7df9a0-2425-4bbf-857b-b000a4129a86 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:52.706541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-be7df9a0-2425-4bbf-857b-b000a4129a86 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:52.830086 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-be7df9a0-2425-4bbf-857b-b000a4129a86 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:52.837847 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-be7df9a0-2425-4bbf-857b-b000a4129a86 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.143376 Jul 28 04:14:52.838405 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1240/1644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:52 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:53.711132 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-db9156a1-afc5-425f-8d7e-c5f66208c47d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:53.711767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-db9156a1-afc5-425f-8d7e-c5f66208c47d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:53.717360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db9156a1-afc5-425f-8d7e-c5f66208c47d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:53.717800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db9156a1-afc5-425f-8d7e-c5f66208c47d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:53.718552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db9156a1-afc5-425f-8d7e-c5f66208c47d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:53.718978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-db9156a1-afc5-425f-8d7e-c5f66208c47d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:53.839614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-db9156a1-afc5-425f-8d7e-c5f66208c47d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:53.846858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-db9156a1-afc5-425f-8d7e-c5f66208c47d tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1471 microversion: 2.1 time: 0.139865 Jul 28 04:14:53.847639 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1241/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:53 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1471 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:53.854249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-981f30e0-80cb-4247-9031-aa723fc8893e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:53.854858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-981f30e0-80cb-4247-9031-aa723fc8893e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:53.860859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-981f30e0-80cb-4247-9031-aa723fc8893e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:53.861310 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-981f30e0-80cb-4247-9031-aa723fc8893e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:53.862108 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-981f30e0-80cb-4247-9031-aa723fc8893e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:53.862544 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-981f30e0-80cb-4247-9031-aa723fc8893e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:53.984771 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-981f30e0-80cb-4247-9031-aa723fc8893e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:53.993202 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-981f30e0-80cb-4247-9031-aa723fc8893e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.142964 Jul 28 04:14:53.993782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1242/1646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:53 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:54.450672 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-6a7491fe-d484-46d2-8c94-f8c08edb2f90 req-5bdcf4bc-745b-4ca4-9250-27ec1548f45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6f0e96-cfbc-4c23-b813-fd8771e5786b", "name": "network-vif-deleted", "tag": "86354c62-042b-4b92-98e0-ec7698d2a068"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:54.452141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:14:54.452141 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:14:54.459051 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-6a7491fe-d484-46d2-8c94-f8c08edb2f90 req-5bdcf4bc-745b-4ca4-9250-27ec1548f45c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:54.459497 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-6a7491fe-d484-46d2-8c94-f8c08edb2f90 req-5bdcf4bc-745b-4ca4-9250-27ec1548f45c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:54.471588 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-6a7491fe-d484-46d2-8c94-f8c08edb2f90 req-5bdcf4bc-745b-4ca4-9250-27ec1548f45c service nova] Creating event network-vif-deleted:86354c62-042b-4b92-98e0-ec7698d2a068 for instance 8e6f0e96-cfbc-4c23-b813-fd8771e5786b on hv-cinder-73306 Jul 28 04:14:54.477332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-6a7491fe-d484-46d2-8c94-f8c08edb2f90 req-5bdcf4bc-745b-4ca4-9250-27ec1548f45c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030183 Jul 28 04:14:54.480645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1243/1647] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:14:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:14:54.865226 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:54.865918 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:54.873206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:54.873918 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:54.874627 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:54.875130 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:54.905626 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:54.906070 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:54.906517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lazy-loading 'fault' on Instance uuid 8e6f0e96-cfbc-4c23-b813-fd8771e5786b {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 04:14:54.948166 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae1a5c628b764cf48b6bb85dd1f1c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e78a86e18c4df3b6a1e756fa51fc10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:54.955457 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0f36ad4a-e90b-4932-bfe9-272c9ea9ee78 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 200 len: 1305 microversion: 2.1 time: 0.094152 Jul 28 04:14:54.956060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1244/1648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:54 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:55.009332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2e89be5c-1b2d-4c66-8bf2-d2c19a622c69 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:55.009938 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2e89be5c-1b2d-4c66-8bf2-d2c19a622c69 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:55.015793 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e89be5c-1b2d-4c66-8bf2-d2c19a622c69 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:55.016194 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e89be5c-1b2d-4c66-8bf2-d2c19a622c69 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:55.016968 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e89be5c-1b2d-4c66-8bf2-d2c19a622c69 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:55.017399 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2e89be5c-1b2d-4c66-8bf2-d2c19a622c69 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:55.142503 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2e89be5c-1b2d-4c66-8bf2-d2c19a622c69 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:55.150686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2e89be5c-1b2d-4c66-8bf2-d2c19a622c69 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.145099 Jul 28 04:14:55.151245 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1245/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:55 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:55.972515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ce5d1845-dbc8-48fc-bd3c-ed1731bdb108 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:55.973203 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ce5d1845-dbc8-48fc-bd3c-ed1731bdb108 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] [instance: 8e6f0e96-cfbc-4c23-b813-fd8771e5786b] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:55.978936 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce5d1845-dbc8-48fc-bd3c-ed1731bdb108 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:55.979381 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce5d1845-dbc8-48fc-bd3c-ed1731bdb108 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:55.980174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce5d1845-dbc8-48fc-bd3c-ed1731bdb108 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:55.980610 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ce5d1845-dbc8-48fc-bd3c-ed1731bdb108 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:55.994762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-ce5d1845-dbc8-48fc-bd3c-ed1731bdb108 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] HTTP exception thrown: Instance 8e6f0e96-cfbc-4c23-b813-fd8771e5786b could not be found. Jul 28 04:14:55.995346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ce5d1845-dbc8-48fc-bd3c-ed1731bdb108 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] Returning 404 to user: Instance 8e6f0e96-cfbc-4c23-b813-fd8771e5786b could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:14:55.996213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ce5d1845-dbc8-48fc-bd3c-ed1731bdb108 tempest-VolumesNegativeTest-763441117 tempest-VolumesNegativeTest-763441117-project] 10.222.0.16 "GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b" status: 404 len: 111 microversion: 2.1 time: 0.027420 Jul 28 04:14:55.996742 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1246/1650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:55 2021] GET /compute/v2.1/servers/8e6f0e96-cfbc-4c23-b813-fd8771e5786b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:14:56.167873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-5a8eccc4-c143-43fd-ba4e-53e1c6cf0f7d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:56.168486 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-5a8eccc4-c143-43fd-ba4e-53e1c6cf0f7d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:56.174413 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a8eccc4-c143-43fd-ba4e-53e1c6cf0f7d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:56.174865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a8eccc4-c143-43fd-ba4e-53e1c6cf0f7d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:56.175634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a8eccc4-c143-43fd-ba4e-53e1c6cf0f7d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:56.176098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-5a8eccc4-c143-43fd-ba4e-53e1c6cf0f7d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:56.303396 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-5a8eccc4-c143-43fd-ba4e-53e1c6cf0f7d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:56.311822 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-5a8eccc4-c143-43fd-ba4e-53e1c6cf0f7d tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.148368 Jul 28 04:14:56.312385 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1247/1651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:56 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:57.329129 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-77a3f9a5-bcb1-4239-8490-1b47921c2d7e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:57.329747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-77a3f9a5-bcb1-4239-8490-1b47921c2d7e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:57.336121 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77a3f9a5-bcb1-4239-8490-1b47921c2d7e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:57.336655 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77a3f9a5-bcb1-4239-8490-1b47921c2d7e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:57.337495 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77a3f9a5-bcb1-4239-8490-1b47921c2d7e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:57.338004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-77a3f9a5-bcb1-4239-8490-1b47921c2d7e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:57.464287 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-77a3f9a5-bcb1-4239-8490-1b47921c2d7e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:57.471992 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-77a3f9a5-bcb1-4239-8490-1b47921c2d7e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.146559 Jul 28 04:14:57.472548 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1248/1652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:57 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:58.493018 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-583acee7-9ff5-472d-b7ce-2e15d4b24f41 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:58.493661 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-583acee7-9ff5-472d-b7ce-2e15d4b24f41 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:58.499559 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-583acee7-9ff5-472d-b7ce-2e15d4b24f41 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:58.500026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-583acee7-9ff5-472d-b7ce-2e15d4b24f41 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:58.500835 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-583acee7-9ff5-472d-b7ce-2e15d4b24f41 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:58.501648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-583acee7-9ff5-472d-b7ce-2e15d4b24f41 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:58.624494 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-583acee7-9ff5-472d-b7ce-2e15d4b24f41 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:58.632541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-583acee7-9ff5-472d-b7ce-2e15d4b24f41 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.146030 Jul 28 04:14:58.633099 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1249/1653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:58 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:59.650264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-37bbd8f4-8a1c-4141-a40c-926ddf8564ec tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:59.650903 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-37bbd8f4-8a1c-4141-a40c-926ddf8564ec tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:14:59.656499 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37bbd8f4-8a1c-4141-a40c-926ddf8564ec tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:59.656944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37bbd8f4-8a1c-4141-a40c-926ddf8564ec tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:59.657768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37bbd8f4-8a1c-4141-a40c-926ddf8564ec tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:14:59.658206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-37bbd8f4-8a1c-4141-a40c-926ddf8564ec tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:14:59.786264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-37bbd8f4-8a1c-4141-a40c-926ddf8564ec tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:59.798745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-37bbd8f4-8a1c-4141-a40c-926ddf8564ec tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.152951 Jul 28 04:14:59.799329 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1250/1654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:14:59 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:00.816135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ef6f8478-4ecd-4a46-8962-05b51ec5e518 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:00.816751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ef6f8478-4ecd-4a46-8962-05b51ec5e518 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:00.823115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef6f8478-4ecd-4a46-8962-05b51ec5e518 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:00.823565 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef6f8478-4ecd-4a46-8962-05b51ec5e518 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:00.824359 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef6f8478-4ecd-4a46-8962-05b51ec5e518 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:00.824790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ef6f8478-4ecd-4a46-8962-05b51ec5e518 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:00.943026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ef6f8478-4ecd-4a46-8962-05b51ec5e518 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:00.951096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ef6f8478-4ecd-4a46-8962-05b51ec5e518 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.138641 Jul 28 04:15:00.951658 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1251/1655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:00 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:01.968579 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-46260283-c87f-459e-a38f-7bc002feb1b1 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:01.969197 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-46260283-c87f-459e-a38f-7bc002feb1b1 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:01.974775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46260283-c87f-459e-a38f-7bc002feb1b1 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:01.975225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46260283-c87f-459e-a38f-7bc002feb1b1 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:01.976037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46260283-c87f-459e-a38f-7bc002feb1b1 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:01.976468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-46260283-c87f-459e-a38f-7bc002feb1b1 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:02.098035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-46260283-c87f-459e-a38f-7bc002feb1b1 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:02.106280 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-46260283-c87f-459e-a38f-7bc002feb1b1 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.141402 Jul 28 04:15:02.106841 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1252/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:01 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:03.123558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3213f36b-5eb5-4b87-87e5-6f8d0c66ea71 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:03.124242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3213f36b-5eb5-4b87-87e5-6f8d0c66ea71 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:03.130131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3213f36b-5eb5-4b87-87e5-6f8d0c66ea71 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:03.130578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3213f36b-5eb5-4b87-87e5-6f8d0c66ea71 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:03.131338 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3213f36b-5eb5-4b87-87e5-6f8d0c66ea71 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:03.131883 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3213f36b-5eb5-4b87-87e5-6f8d0c66ea71 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:03.254151 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-3213f36b-5eb5-4b87-87e5-6f8d0c66ea71 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:03.261894 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3213f36b-5eb5-4b87-87e5-6f8d0c66ea71 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.142022 Jul 28 04:15:03.262451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1253/1657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:03 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:04.278397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0c983320-a654-4124-b7ec-16c1b2947946 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:04.279035 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0c983320-a654-4124-b7ec-16c1b2947946 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:04.285111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c983320-a654-4124-b7ec-16c1b2947946 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:04.285589 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c983320-a654-4124-b7ec-16c1b2947946 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:04.286529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c983320-a654-4124-b7ec-16c1b2947946 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:04.286996 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0c983320-a654-4124-b7ec-16c1b2947946 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:04.651545 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0c983320-a654-4124-b7ec-16c1b2947946 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:04.659364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0c983320-a654-4124-b7ec-16c1b2947946 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1756 microversion: 2.1 time: 0.384674 Jul 28 04:15:04.659952 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1254/1658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:04 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1756 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:05.677033 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f13cc25d-46cb-4942-81c4-484fafacdba9 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:05.677669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f13cc25d-46cb-4942-81c4-484fafacdba9 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:05.684127 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f13cc25d-46cb-4942-81c4-484fafacdba9 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:05.684581 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f13cc25d-46cb-4942-81c4-484fafacdba9 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:05.685346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f13cc25d-46cb-4942-81c4-484fafacdba9 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:05.685786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f13cc25d-46cb-4942-81c4-484fafacdba9 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:05.807089 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-f13cc25d-46cb-4942-81c4-484fafacdba9 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:05.814860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f13cc25d-46cb-4942-81c4-484fafacdba9 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1759 microversion: 2.1 time: 0.141504 Jul 28 04:15:05.815417 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1255/1659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:05 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1759 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:20.652356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-3ced7fdc-326c-485c-9638-9bd7d444387d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:20.652975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3ced7fdc-326c-485c-9638-9bd7d444387d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:20.659088 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ced7fdc-326c-485c-9638-9bd7d444387d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:20.659530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ced7fdc-326c-485c-9638-9bd7d444387d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:20.660332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ced7fdc-326c-485c-9638-9bd7d444387d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:20.660762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-3ced7fdc-326c-485c-9638-9bd7d444387d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:20.686744 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-3ced7fdc-326c-485c-9638-9bd7d444387d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 04:15:20.757534 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-3ced7fdc-326c-485c-9638-9bd7d444387d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 204 len: 0 microversion: 2.1 time: 0.108079 Jul 28 04:15:20.758412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1256/1660] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:15:20 2021] DELETE /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:15:20.766577 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ab45878f-32bd-4038-98c0-951a8fb4cd4f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:20.767264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ab45878f-32bd-4038-98c0-951a8fb4cd4f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:20.774020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab45878f-32bd-4038-98c0-951a8fb4cd4f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:20.774464 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab45878f-32bd-4038-98c0-951a8fb4cd4f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:20.775219 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab45878f-32bd-4038-98c0-951a8fb4cd4f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:20.775648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ab45878f-32bd-4038-98c0-951a8fb4cd4f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:20.898135 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ab45878f-32bd-4038-98c0-951a8fb4cd4f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:20.905400 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ab45878f-32bd-4038-98c0-951a8fb4cd4f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1577 microversion: 2.1 time: 0.142717 Jul 28 04:15:20.905973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1257/1661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:20 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1577 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:21.923277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-17bbfb6c-845f-421d-9633-b663a5d09e84 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:21.923961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-17bbfb6c-845f-421d-9633-b663a5d09e84 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:21.930596 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17bbfb6c-845f-421d-9633-b663a5d09e84 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:21.931047 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17bbfb6c-845f-421d-9633-b663a5d09e84 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:21.931867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17bbfb6c-845f-421d-9633-b663a5d09e84 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:21.932296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-17bbfb6c-845f-421d-9633-b663a5d09e84 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:22.051056 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-17bbfb6c-845f-421d-9633-b663a5d09e84 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:22.058529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-17bbfb6c-845f-421d-9633-b663a5d09e84 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1577 microversion: 2.1 time: 0.138945 Jul 28 04:15:22.059092 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1258/1662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:21 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1577 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:23.075987 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ac2bac79-a108-4546-8b93-24ee354ef511 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:23.076603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ac2bac79-a108-4546-8b93-24ee354ef511 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:23.082228 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac2bac79-a108-4546-8b93-24ee354ef511 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:23.082683 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac2bac79-a108-4546-8b93-24ee354ef511 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:23.083458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac2bac79-a108-4546-8b93-24ee354ef511 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:23.083974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ac2bac79-a108-4546-8b93-24ee354ef511 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:23.166608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ac2bac79-a108-4546-8b93-24ee354ef511 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:23.173951 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ac2bac79-a108-4546-8b93-24ee354ef511 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1509 microversion: 2.1 time: 0.101793 Jul 28 04:15:23.174508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1259/1663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:23 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1509 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:23.430947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-89454c93-8a45-43c1-91ef-5c30b2d65e0c req-d0be65d1-8eb5-4a24-b885-62e1a23db2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3a4679-ad02-41d6-9d56-5e56a98e9d88", "name": "network-vif-deleted", "tag": "f7ca3e2b-1a50-41cb-b2b5-715307bf1158"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:23.433734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:15:23.433734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:15:23.443669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-89454c93-8a45-43c1-91ef-5c30b2d65e0c req-d0be65d1-8eb5-4a24-b885-62e1a23db2be service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:23.444421 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-89454c93-8a45-43c1-91ef-5c30b2d65e0c req-d0be65d1-8eb5-4a24-b885-62e1a23db2be service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:23.457824 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-89454c93-8a45-43c1-91ef-5c30b2d65e0c req-d0be65d1-8eb5-4a24-b885-62e1a23db2be service nova] Creating event network-vif-deleted:f7ca3e2b-1a50-41cb-b2b5-715307bf1158 for instance 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 on hv-cinder-73306 Jul 28 04:15:23.465191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-89454c93-8a45-43c1-91ef-5c30b2d65e0c req-d0be65d1-8eb5-4a24-b885-62e1a23db2be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038595 Jul 28 04:15:23.465975 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1260/1664] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:15:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:24.190469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:24.191323 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:24.197993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:24.198440 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:24.199192 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:24.199625 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:24.237057 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:24.237508 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:24.238419 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lazy-loading 'fault' on Instance uuid 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 04:15:24.284462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:24.297030 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-9092710e-5b20-48f6-a5f2-c3f14896a0aa tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 200 len: 1230 microversion: 2.1 time: 0.109996 Jul 28 04:15:24.298334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1261/1665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:24 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:25.315093 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-54efad83-c085-465a-b9d3-1e6d0df2198f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:25.315723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-54efad83-c085-465a-b9d3-1e6d0df2198f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:25.322111 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54efad83-c085-465a-b9d3-1e6d0df2198f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:25.322559 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54efad83-c085-465a-b9d3-1e6d0df2198f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:25.323319 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54efad83-c085-465a-b9d3-1e6d0df2198f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:25.323769 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-54efad83-c085-465a-b9d3-1e6d0df2198f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:25.336645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-54efad83-c085-465a-b9d3-1e6d0df2198f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] HTTP exception thrown: Instance 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 could not be found. Jul 28 04:15:25.337210 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-54efad83-c085-465a-b9d3-1e6d0df2198f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Returning 404 to user: Instance 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:15:25.338015 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-54efad83-c085-465a-b9d3-1e6d0df2198f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 404 len: 111 microversion: 2.1 time: 0.026595 Jul 28 04:15:25.338510 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1262/1666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:25 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:15:25.427393 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-600499966", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1625188612", "security_groups": [{"name": "tempest-secgroup-smoke-1739001634"}], "block_device_mapping_v2": [{"uuid": "d787cfea-b837-4be1-b060-405ca577292c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9995752f-26c8-499b-851d-ac24052e53ae"}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:25.528541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] validate_networks() for [('9995752f-26c8-499b-851d-ac24052e53ae', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 04:15:25.889316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:15:25.889765 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:15:25.890236 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:15:25.890665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:15:25.891068 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:15:25.899623 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:25.900098 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:25.900885 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:25.901314 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:25.916740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Getting quotas for project 699932c5162645f89bbd9d95710d863b. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 04:15:25.920611 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Getting quotas for user 21290886e90f45f582840b785d64cd43 and project 699932c5162645f89bbd9d95710d863b. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 04:15:25.980278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 04:15:25.982390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d787cfea-b837-4be1-b060-405ca577292c',volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 04:15:26.100944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f64974cf-986b-4436-b038-c3104105c126 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.676521 Jul 28 04:15:26.101885 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1263/1667] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 04:15:25 2021] POST /compute/v2.1/servers => generated 406 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:15:26.111130 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-126e688c-9ec7-4418-86b5-0f16b866d4b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:26.111767 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-126e688c-9ec7-4418-86b5-0f16b866d4b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:26.172944 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-126e688c-9ec7-4418-86b5-0f16b866d4b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:26.180539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-126e688c-9ec7-4418-86b5-0f16b866d4b9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1094 microversion: 2.1 time: 0.073050 Jul 28 04:15:26.181087 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1264/1668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:26 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:27.197807 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d5ef8b4c-8ece-423e-838b-6899c44238d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:27.198430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d5ef8b4c-8ece-423e-838b-6899c44238d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:27.204180 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5ef8b4c-8ece-423e-838b-6899c44238d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:27.204740 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5ef8b4c-8ece-423e-838b-6899c44238d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:27.205810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5ef8b4c-8ece-423e-838b-6899c44238d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:27.206304 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d5ef8b4c-8ece-423e-838b-6899c44238d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:27.306303 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d5ef8b4c-8ece-423e-838b-6899c44238d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:27.313686 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d5ef8b4c-8ece-423e-838b-6899c44238d5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1210 microversion: 2.1 time: 0.120322 Jul 28 04:15:27.314257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1265/1669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:27 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:28.331776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-57e444f1-26f3-40ac-be47-7ed00523bcd1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:28.332552 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-57e444f1-26f3-40ac-be47-7ed00523bcd1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:28.339004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57e444f1-26f3-40ac-be47-7ed00523bcd1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:28.339454 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57e444f1-26f3-40ac-be47-7ed00523bcd1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:28.340704 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57e444f1-26f3-40ac-be47-7ed00523bcd1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:28.341105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57e444f1-26f3-40ac-be47-7ed00523bcd1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:28.586222 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-57e444f1-26f3-40ac-be47-7ed00523bcd1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:28.596800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-57e444f1-26f3-40ac-be47-7ed00523bcd1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.267587 Jul 28 04:15:28.599357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1266/1670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:28 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:28.605315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-9206ee23-45ee-4dfe-ad95-16bfd62a845f req-4896e320-1062-47e8-8bd4-8d7d62ab157f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb64262-ada3-4a82-b9cf-2c15cb9bd809", "tag": "a40c7d93-c9e2-45ad-aa9d-d3ac36535c30"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:28.608011 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:15:28.608011 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:15:28.616838 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-9206ee23-45ee-4dfe-ad95-16bfd62a845f req-4896e320-1062-47e8-8bd4-8d7d62ab157f service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:28.617579 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-9206ee23-45ee-4dfe-ad95-16bfd62a845f req-4896e320-1062-47e8-8bd4-8d7d62ab157f service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:28.630804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-9206ee23-45ee-4dfe-ad95-16bfd62a845f req-4896e320-1062-47e8-8bd4-8d7d62ab157f service nova] Creating event network-changed:a40c7d93-c9e2-45ad-aa9d-d3ac36535c30 for instance 0eb64262-ada3-4a82-b9cf-2c15cb9bd809 on hv-cinder-73306 Jul 28 04:15:28.641384 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-9206ee23-45ee-4dfe-ad95-16bfd62a845f req-4896e320-1062-47e8-8bd4-8d7d62ab157f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037106 Jul 28 04:15:28.646294 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1267/1671] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:15:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:29.619335 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-71e92cf4-8c8e-4057-bedb-49e9709b5793 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:29.620064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-71e92cf4-8c8e-4057-bedb-49e9709b5793 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:29.625913 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71e92cf4-8c8e-4057-bedb-49e9709b5793 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:29.626360 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71e92cf4-8c8e-4057-bedb-49e9709b5793 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:29.627118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71e92cf4-8c8e-4057-bedb-49e9709b5793 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:29.627558 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71e92cf4-8c8e-4057-bedb-49e9709b5793 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:29.746230 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-71e92cf4-8c8e-4057-bedb-49e9709b5793 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:29.753315 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-71e92cf4-8c8e-4057-bedb-49e9709b5793 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.138658 Jul 28 04:15:29.753881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1268/1672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:29 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:30.769539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8e609905-dc63-4c02-96c7-aa3ed878d902 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:30.770184 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8e609905-dc63-4c02-96c7-aa3ed878d902 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:30.776688 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e609905-dc63-4c02-96c7-aa3ed878d902 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:30.777138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e609905-dc63-4c02-96c7-aa3ed878d902 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:30.777901 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e609905-dc63-4c02-96c7-aa3ed878d902 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:30.778337 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8e609905-dc63-4c02-96c7-aa3ed878d902 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:30.895529 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8e609905-dc63-4c02-96c7-aa3ed878d902 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:30.903277 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8e609905-dc63-4c02-96c7-aa3ed878d902 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.137422 Jul 28 04:15:30.903859 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1269/1673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:30 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:31.919762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-50cbe2d0-0ab3-4aa9-9b89-d055b6064c73 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:31.920412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-50cbe2d0-0ab3-4aa9-9b89-d055b6064c73 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:31.926117 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50cbe2d0-0ab3-4aa9-9b89-d055b6064c73 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:31.926567 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50cbe2d0-0ab3-4aa9-9b89-d055b6064c73 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:31.927328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50cbe2d0-0ab3-4aa9-9b89-d055b6064c73 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:31.927795 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50cbe2d0-0ab3-4aa9-9b89-d055b6064c73 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:32.049578 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-50cbe2d0-0ab3-4aa9-9b89-d055b6064c73 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:32.056694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-50cbe2d0-0ab3-4aa9-9b89-d055b6064c73 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.140621 Jul 28 04:15:32.057260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1270/1674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:31 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:33.073524 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-530ad61d-b765-42fb-9e34-180d567358b2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:33.074080 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-530ad61d-b765-42fb-9e34-180d567358b2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:33.079833 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-530ad61d-b765-42fb-9e34-180d567358b2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:33.080285 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-530ad61d-b765-42fb-9e34-180d567358b2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:33.081046 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-530ad61d-b765-42fb-9e34-180d567358b2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:33.081483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-530ad61d-b765-42fb-9e34-180d567358b2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:33.199484 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-530ad61d-b765-42fb-9e34-180d567358b2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:33.206643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-530ad61d-b765-42fb-9e34-180d567358b2 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.136883 Jul 28 04:15:33.207403 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1271/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:33 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:34.223872 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ff4dadb2-65e1-4536-b41e-c5b9b0afc778 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:34.224514 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ff4dadb2-65e1-4536-b41e-c5b9b0afc778 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:34.230942 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ff4dadb2-65e1-4536-b41e-c5b9b0afc778 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:34.231387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ff4dadb2-65e1-4536-b41e-c5b9b0afc778 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:34.232179 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ff4dadb2-65e1-4536-b41e-c5b9b0afc778 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:34.232613 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ff4dadb2-65e1-4536-b41e-c5b9b0afc778 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:34.352213 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ff4dadb2-65e1-4536-b41e-c5b9b0afc778 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:34.359573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ff4dadb2-65e1-4536-b41e-c5b9b0afc778 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.139439 Jul 28 04:15:34.360158 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1272/1676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:34 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:35.375772 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-7ee945bd-75c3-47f3-90ab-fedd9d7a8ad3 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:35.376357 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-7ee945bd-75c3-47f3-90ab-fedd9d7a8ad3 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:35.382102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ee945bd-75c3-47f3-90ab-fedd9d7a8ad3 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:35.382632 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ee945bd-75c3-47f3-90ab-fedd9d7a8ad3 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:35.383390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ee945bd-75c3-47f3-90ab-fedd9d7a8ad3 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:35.383850 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-7ee945bd-75c3-47f3-90ab-fedd9d7a8ad3 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:35.504782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-7ee945bd-75c3-47f3-90ab-fedd9d7a8ad3 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:35.512389 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-7ee945bd-75c3-47f3-90ab-fedd9d7a8ad3 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.140416 Jul 28 04:15:35.512934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1273/1677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:35 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:36.529415 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-0234fe3f-6642-46bd-9e09-d4e7f370e906 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:36.530032 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-0234fe3f-6642-46bd-9e09-d4e7f370e906 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:36.536993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0234fe3f-6642-46bd-9e09-d4e7f370e906 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:36.537442 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0234fe3f-6642-46bd-9e09-d4e7f370e906 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:36.538345 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0234fe3f-6642-46bd-9e09-d4e7f370e906 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:36.538782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-0234fe3f-6642-46bd-9e09-d4e7f370e906 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:36.658078 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-0234fe3f-6642-46bd-9e09-d4e7f370e906 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:36.665710 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-0234fe3f-6642-46bd-9e09-d4e7f370e906 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.140072 Jul 28 04:15:36.666264 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1274/1678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:36 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:37.682076 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-e7ebd098-0359-4df1-9529-1eaab11a403d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:37.682700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-e7ebd098-0359-4df1-9529-1eaab11a403d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:37.688521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7ebd098-0359-4df1-9529-1eaab11a403d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:37.688970 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7ebd098-0359-4df1-9529-1eaab11a403d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:37.689728 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7ebd098-0359-4df1-9529-1eaab11a403d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:37.690163 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-e7ebd098-0359-4df1-9529-1eaab11a403d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:37.808594 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-e7ebd098-0359-4df1-9529-1eaab11a403d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:37.815863 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-e7ebd098-0359-4df1-9529-1eaab11a403d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.137548 Jul 28 04:15:37.816418 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1275/1679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:37 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:37.870834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8ef77240-6f77-4040-b2ba-bb606f8e0639 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-911483751"}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:37.871376 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8ef77240-6f77-4040-b2ba-bb606f8e0639 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:37.877340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8ef77240-6f77-4040-b2ba-bb606f8e0639 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:37.877792 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8ef77240-6f77-4040-b2ba-bb606f8e0639 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:37.878564 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8ef77240-6f77-4040-b2ba-bb606f8e0639 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:37.879058 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8ef77240-6f77-4040-b2ba-bb606f8e0639 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:37.998296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.network.security_group_api [None req-8ef77240-6f77-4040-b2ba-bb606f8e0639 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Removing security group a863edcc-de8b-4856-9ed4-794d026fc013 from port f36bc118-6ca3-4be9-8638-9c6343d7762b Jul 28 04:15:38.321309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8ef77240-6f77-4040-b2ba-bb606f8e0639 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "POST /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.454093 Jul 28 04:15:38.325380 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1276/1680] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Jul 28 04:15:37 2021] POST /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:15:38.338979 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-a4772d56-a085-40d3-9671-ff2cf567d0d1 req-a64a7e22-a843-4ff4-a3fa-39c30348c9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f6dd1e-63fa-47d5-a20c-ab7c80534b5c", "tag": "f36bc118-6ca3-4be9-8638-9c6343d7762b"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:38.341533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:15:38.341533 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:15:38.348700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-a4772d56-a085-40d3-9671-ff2cf567d0d1 req-a64a7e22-a843-4ff4-a3fa-39c30348c9a0 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:38.357102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-a4772d56-a085-40d3-9671-ff2cf567d0d1 req-a64a7e22-a843-4ff4-a3fa-39c30348c9a0 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:38.371109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-a4772d56-a085-40d3-9671-ff2cf567d0d1 req-a64a7e22-a843-4ff4-a3fa-39c30348c9a0 service nova] Creating event network-changed:f36bc118-6ca3-4be9-8638-9c6343d7762b for instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c on hv-cinder-73306 Jul 28 04:15:38.377796 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-a4772d56-a085-40d3-9671-ff2cf567d0d1 req-a64a7e22-a843-4ff4-a3fa-39c30348c9a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047806 Jul 28 04:15:38.378753 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1277/1681] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:15:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:38.833780 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d1da882e-223e-4fd6-8109-37d2dd9f8d40 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:38.836002 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d1da882e-223e-4fd6-8109-37d2dd9f8d40 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:38.842320 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d1da882e-223e-4fd6-8109-37d2dd9f8d40 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:38.843066 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d1da882e-223e-4fd6-8109-37d2dd9f8d40 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:38.844232 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d1da882e-223e-4fd6-8109-37d2dd9f8d40 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:38.844865 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d1da882e-223e-4fd6-8109-37d2dd9f8d40 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:39.272045 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d1da882e-223e-4fd6-8109-37d2dd9f8d40 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:39.280260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d1da882e-223e-4fd6-8109-37d2dd9f8d40 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.450514 Jul 28 04:15:39.280834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1278/1682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:38 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:39.439115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-fd9d1ca4-2546-4811-a7fd-3a546d96e62e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:39.439606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-fd9d1ca4-2546-4811-a7fd-3a546d96e62e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:39.446424 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fd9d1ca4-2546-4811-a7fd-3a546d96e62e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:39.446870 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fd9d1ca4-2546-4811-a7fd-3a546d96e62e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:39.447635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fd9d1ca4-2546-4811-a7fd-3a546d96e62e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:39.448145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-fd9d1ca4-2546-4811-a7fd-3a546d96e62e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:39.531328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.objects.instance [None req-fd9d1ca4-2546-4811-a7fd-3a546d96e62e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lazy-loading 'services' on Instance uuid 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c {{(pid=119154) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 28 04:15:39.600530 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-fd9d1ca4-2546-4811-a7fd-3a546d96e62e tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/os-volume_attachments/c783b457-c267-4ed4-a70f-f2484965c800" status: 202 len: 0 microversion: 2.1 time: 0.164911 Jul 28 04:15:39.601229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1279/1683] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Jul 28 04:15:39 2021] DELETE /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/os-volume_attachments/c783b457-c267-4ed4-a70f-f2484965c800 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:15:39.608709 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-95643c6a-946d-4843-9dbe-2969fe302a07 req-8c0bbb4a-28e5-4b77-877d-2df5f41861ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71f6dd1e-63fa-47d5-a20c-ab7c80534b5c", "tag": "f36bc118-6ca3-4be9-8638-9c6343d7762b"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:39.610461 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:15:39.610461 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:15:39.620026 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-95643c6a-946d-4843-9dbe-2969fe302a07 req-8c0bbb4a-28e5-4b77-877d-2df5f41861ba service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:39.620469 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-95643c6a-946d-4843-9dbe-2969fe302a07 req-8c0bbb4a-28e5-4b77-877d-2df5f41861ba service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:39.632334 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-95643c6a-946d-4843-9dbe-2969fe302a07 req-8c0bbb4a-28e5-4b77-877d-2df5f41861ba service nova] Creating event network-changed:f36bc118-6ca3-4be9-8638-9c6343d7762b for instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c on hv-cinder-73306 Jul 28 04:15:39.637308 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-95643c6a-946d-4843-9dbe-2969fe302a07 req-8c0bbb4a-28e5-4b77-877d-2df5f41861ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034742 Jul 28 04:15:39.637930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1280/1684] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:15:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:39.643839 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-f5672298-bb42-4267-8888-a41013b0108c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:39.645253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-f5672298-bb42-4267-8888-a41013b0108c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:39.651693 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5672298-bb42-4267-8888-a41013b0108c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:39.652104 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5672298-bb42-4267-8888-a41013b0108c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:39.652881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5672298-bb42-4267-8888-a41013b0108c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:39.653319 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-f5672298-bb42-4267-8888-a41013b0108c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:39.684862 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-f5672298-bb42-4267-8888-a41013b0108c tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Jul 28 04:15:39.685607 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1281/1685] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Jul 28 04:15:39 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:40.165427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-6c11209e-ea0f-498a-a405-ca71e8e120ed req-0e5cef06-46b4-49ec-bbd2-97d6adbb3133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb64262-ada3-4a82-b9cf-2c15cb9bd809", "name": "network-vif-plugged", "status": "completed", "tag": "a40c7d93-c9e2-45ad-aa9d-d3ac36535c30"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:40.167757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:15:40.167757 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:15:40.176608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-6c11209e-ea0f-498a-a405-ca71e8e120ed req-0e5cef06-46b4-49ec-bbd2-97d6adbb3133 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:40.177468 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-6c11209e-ea0f-498a-a405-ca71e8e120ed req-0e5cef06-46b4-49ec-bbd2-97d6adbb3133 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:40.196064 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-6c11209e-ea0f-498a-a405-ca71e8e120ed req-0e5cef06-46b4-49ec-bbd2-97d6adbb3133 service nova] Creating event network-vif-plugged:a40c7d93-c9e2-45ad-aa9d-d3ac36535c30 for instance 0eb64262-ada3-4a82-b9cf-2c15cb9bd809 on hv-cinder-73306 Jul 28 04:15:40.202281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-6c11209e-ea0f-498a-a405-ca71e8e120ed req-0e5cef06-46b4-49ec-bbd2-97d6adbb3133 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043556 Jul 28 04:15:40.202881 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1282/1686] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:15:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:40.298519 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-650a624d-8fa8-4238-a8ff-8faf095a72c1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:40.299341 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-650a624d-8fa8-4238-a8ff-8faf095a72c1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:40.308298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-650a624d-8fa8-4238-a8ff-8faf095a72c1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:40.308830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-650a624d-8fa8-4238-a8ff-8faf095a72c1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:40.309679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-650a624d-8fa8-4238-a8ff-8faf095a72c1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:40.310467 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-650a624d-8fa8-4238-a8ff-8faf095a72c1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:40.478685 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-650a624d-8fa8-4238-a8ff-8faf095a72c1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:40.488564 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-650a624d-8fa8-4238-a8ff-8faf095a72c1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.194667 Jul 28 04:15:40.489444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1283/1687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:40 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:40.695890 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-509fd1b9-b7d3-408b-9d23-e21e56c7ae2f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:40.696745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-509fd1b9-b7d3-408b-9d23-e21e56c7ae2f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:40.704001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-509fd1b9-b7d3-408b-9d23-e21e56c7ae2f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:40.704450 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-509fd1b9-b7d3-408b-9d23-e21e56c7ae2f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:40.705235 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-509fd1b9-b7d3-408b-9d23-e21e56c7ae2f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:40.705669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-509fd1b9-b7d3-408b-9d23-e21e56c7ae2f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:40.736427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-509fd1b9-b7d3-408b-9d23-e21e56c7ae2f tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044497 Jul 28 04:15:40.736988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1284/1688] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Jul 28 04:15:40 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 04:15:40.746227 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-28a27389-5ed9-4faf-afdc-120782af505a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:40.746712 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-28a27389-5ed9-4faf-afdc-120782af505a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:40.752164 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28a27389-5ed9-4faf-afdc-120782af505a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:40.752614 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28a27389-5ed9-4faf-afdc-120782af505a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:40.753370 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28a27389-5ed9-4faf-afdc-120782af505a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:40.753805 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-28a27389-5ed9-4faf-afdc-120782af505a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:40.830233 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-28a27389-5ed9-4faf-afdc-120782af505a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] HTTP exception thrown: Instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c is not attached to volume c783b457-c267-4ed4-a70f-f2484965c800 Jul 28 04:15:40.830860 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-28a27389-5ed9-4faf-afdc-120782af505a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Returning 404 to user: Instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c is not attached to volume c783b457-c267-4ed4-a70f-f2484965c800 {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:15:40.831700 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-28a27389-5ed9-4faf-afdc-120782af505a tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/os-volume_attachments/c783b457-c267-4ed4-a70f-f2484965c800" status: 404 len: 154 microversion: 2.1 time: 0.088898 Jul 28 04:15:40.832262 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1285/1689] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Jul 28 04:15:40 2021] DELETE /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c/os-volume_attachments/c783b457-c267-4ed4-a70f-f2484965c800 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:15:41.504583 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-682df67c-e33b-43ed-8965-8bfc93bb2213 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:41.505247 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-682df67c-e33b-43ed-8965-8bfc93bb2213 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:41.512506 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-682df67c-e33b-43ed-8965-8bfc93bb2213 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:41.512947 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-682df67c-e33b-43ed-8965-8bfc93bb2213 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:41.513711 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-682df67c-e33b-43ed-8965-8bfc93bb2213 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:41.514140 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-682df67c-e33b-43ed-8965-8bfc93bb2213 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:41.649802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-682df67c-e33b-43ed-8965-8bfc93bb2213 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:41.656897 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-682df67c-e33b-43ed-8965-8bfc93bb2213 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1266 microversion: 2.1 time: 0.156203 Jul 28 04:15:41.657447 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1286/1690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:41 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:41.961352 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ec8e63cd-71b3-4694-ae99-74112d3b2763 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:41.961842 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ec8e63cd-71b3-4694-ae99-74112d3b2763 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:41.967517 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec8e63cd-71b3-4694-ae99-74112d3b2763 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:41.967995 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec8e63cd-71b3-4694-ae99-74112d3b2763 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:41.968751 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec8e63cd-71b3-4694-ae99-74112d3b2763 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:41.969176 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ec8e63cd-71b3-4694-ae99-74112d3b2763 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:41.992916 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ec8e63cd-71b3-4694-ae99-74112d3b2763 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 04:15:42.063138 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ec8e63cd-71b3-4694-ae99-74112d3b2763 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "DELETE /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 204 len: 0 microversion: 2.1 time: 0.105669 Jul 28 04:15:42.063802 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1287/1691] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:15:41 2021] DELETE /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:15:42.072358 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eeea28ec-dd84-43cf-9c1a-245767f04b20 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:42.073061 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eeea28ec-dd84-43cf-9c1a-245767f04b20 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:42.078681 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eeea28ec-dd84-43cf-9c1a-245767f04b20 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:42.079133 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eeea28ec-dd84-43cf-9c1a-245767f04b20 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:42.079939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eeea28ec-dd84-43cf-9c1a-245767f04b20 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:42.080382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eeea28ec-dd84-43cf-9c1a-245767f04b20 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:42.204061 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eeea28ec-dd84-43cf-9c1a-245767f04b20 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:42.211932 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eeea28ec-dd84-43cf-9c1a-245767f04b20 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1555 microversion: 2.1 time: 0.143486 Jul 28 04:15:42.212484 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1288/1692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:42 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1555 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:42.674662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-93440cef-cac5-4e43-98a7-235380756f30 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:42.675331 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-93440cef-cac5-4e43-98a7-235380756f30 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:42.681734 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93440cef-cac5-4e43-98a7-235380756f30 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:42.682185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93440cef-cac5-4e43-98a7-235380756f30 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:42.682971 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93440cef-cac5-4e43-98a7-235380756f30 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:42.683390 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-93440cef-cac5-4e43-98a7-235380756f30 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:42.802972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-93440cef-cac5-4e43-98a7-235380756f30 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:42.810650 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-93440cef-cac5-4e43-98a7-235380756f30 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1452 microversion: 2.1 time: 0.139676 Jul 28 04:15:42.811200 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1289/1693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:42 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:42.825800 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-68f37c83-929a-434f-b0c0-dcdd33d82bbe tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:42.826474 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-68f37c83-929a-434f-b0c0-dcdd33d82bbe tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:42.831694 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68f37c83-929a-434f-b0c0-dcdd33d82bbe tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:42.832162 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68f37c83-929a-434f-b0c0-dcdd33d82bbe tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:42.832907 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68f37c83-929a-434f-b0c0-dcdd33d82bbe tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:42.833333 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-68f37c83-929a-434f-b0c0-dcdd33d82bbe tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:42.951515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-68f37c83-929a-434f-b0c0-dcdd33d82bbe tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:42.958713 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-68f37c83-929a-434f-b0c0-dcdd33d82bbe tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1452 microversion: 2.1 time: 0.136146 Jul 28 04:15:42.959269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1290/1694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:42 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:43.228954 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8697b5ad-aec4-400e-a0d8-87ff21826a52 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:43.229456 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8697b5ad-aec4-400e-a0d8-87ff21826a52 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:43.235270 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8697b5ad-aec4-400e-a0d8-87ff21826a52 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:43.235736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8697b5ad-aec4-400e-a0d8-87ff21826a52 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:43.236496 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8697b5ad-aec4-400e-a0d8-87ff21826a52 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:43.236923 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8697b5ad-aec4-400e-a0d8-87ff21826a52 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:43.433603 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8697b5ad-aec4-400e-a0d8-87ff21826a52 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:43.440880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8697b5ad-aec4-400e-a0d8-87ff21826a52 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1555 microversion: 2.1 time: 0.216114 Jul 28 04:15:43.441438 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1291/1695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:43 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:44.458281 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ae747948-c321-416c-8051-8a8ac9e76fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:44.458906 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ae747948-c321-416c-8051-8a8ac9e76fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:44.464760 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae747948-c321-416c-8051-8a8ac9e76fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:44.465246 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae747948-c321-416c-8051-8a8ac9e76fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:44.466012 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae747948-c321-416c-8051-8a8ac9e76fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:44.466448 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ae747948-c321-416c-8051-8a8ac9e76fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:44.746297 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ae747948-c321-416c-8051-8a8ac9e76fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a85216c17234c099440b2e2c7934755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce504669b154dd7b2cb45a21d8b889b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:44.754781 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ae747948-c321-416c-8051-8a8ac9e76fd6 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 200 len: 1555 microversion: 2.1 time: 0.300193 Jul 28 04:15:44.755554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1292/1696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:44 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 1555 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:44.880278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-a5df666f-f7b1-498a-bd1e-52ee37883b34 req-5fd1c3c9-4503-44a3-8def-37fd12d11082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71f6dd1e-63fa-47d5-a20c-ab7c80534b5c", "name": "network-vif-deleted", "tag": "f36bc118-6ca3-4be9-8638-9c6343d7762b"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:44.881930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:15:44.881930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:15:44.889317 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-a5df666f-f7b1-498a-bd1e-52ee37883b34 req-5fd1c3c9-4503-44a3-8def-37fd12d11082 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:44.889761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-a5df666f-f7b1-498a-bd1e-52ee37883b34 req-5fd1c3c9-4503-44a3-8def-37fd12d11082 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:44.901507 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-a5df666f-f7b1-498a-bd1e-52ee37883b34 req-5fd1c3c9-4503-44a3-8def-37fd12d11082 service nova] Creating event network-vif-deleted:f36bc118-6ca3-4be9-8638-9c6343d7762b for instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c on hv-cinder-73306 Jul 28 04:15:44.906678 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-a5df666f-f7b1-498a-bd1e-52ee37883b34 req-5fd1c3c9-4503-44a3-8def-37fd12d11082 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030261 Jul 28 04:15:44.907762 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1293/1697] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:15:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:15:45.772843 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2f3885b7-600d-4f5c-af9b-9cc0d0eeb1e7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:45.774441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2f3885b7-600d-4f5c-af9b-9cc0d0eeb1e7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] [instance: 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:15:45.780526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f3885b7-600d-4f5c-af9b-9cc0d0eeb1e7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:45.780993 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f3885b7-600d-4f5c-af9b-9cc0d0eeb1e7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:45.781778 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f3885b7-600d-4f5c-af9b-9cc0d0eeb1e7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:45.782209 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2f3885b7-600d-4f5c-af9b-9cc0d0eeb1e7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:45.796683 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-2f3885b7-600d-4f5c-af9b-9cc0d0eeb1e7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] HTTP exception thrown: Instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c could not be found. Jul 28 04:15:45.797278 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2f3885b7-600d-4f5c-af9b-9cc0d0eeb1e7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Returning 404 to user: Instance 71f6dd1e-63fa-47d5-a20c-ab7c80534b5c could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:15:45.798102 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2f3885b7-600d-4f5c-af9b-9cc0d0eeb1e7 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c" status: 404 len: 111 microversion: 2.1 time: 0.030106 Jul 28 04:15:45.798643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1294/1698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:15:45 2021] GET /compute/v2.1/servers/71f6dd1e-63fa-47d5-a20c-ab7c80534b5c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:15:45.806642 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2cdb7250-71fa-495b-a945-411f6f6a71f4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] Calling method '.version_select at 0x7f6806a78f70>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:45.824973 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2cdb7250-71fa-495b-a945-411f6f6a71f4 tempest-TestMinimumBasicScenario-1559895155 tempest-TestMinimumBasicScenario-1559895155-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1032708614" status: 202 len: 0 microversion: 2.1 time: 0.021755 Jul 28 04:15:45.825640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1295/1699] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Jul 28 04:15:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1032708614 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:15:46.959265 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-57352574-e14a-4632-99d2-634ee7b217c5 req-05054bd9-f692-44b5-a114-dd88a889aa3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb64262-ada3-4a82-b9cf-2c15cb9bd809", "tag": "a40c7d93-c9e2-45ad-aa9d-d3ac36535c30"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:46.961522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:15:46.961522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:15:46.968388 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-57352574-e14a-4632-99d2-634ee7b217c5 req-05054bd9-f692-44b5-a114-dd88a889aa3e service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:15:46.968826 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-57352574-e14a-4632-99d2-634ee7b217c5 req-05054bd9-f692-44b5-a114-dd88a889aa3e service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:15:46.979296 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-57352574-e14a-4632-99d2-634ee7b217c5 req-05054bd9-f692-44b5-a114-dd88a889aa3e service nova] Creating event network-changed:a40c7d93-c9e2-45ad-aa9d-d3ac36535c30 for instance 0eb64262-ada3-4a82-b9cf-2c15cb9bd809 on hv-cinder-73306 Jul 28 04:15:46.984206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-57352574-e14a-4632-99d2-634ee7b217c5 req-05054bd9-f692-44b5-a114-dd88a889aa3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028476 Jul 28 04:15:46.984787 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1296/1700] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:15:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:17:19.674898 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1405132505", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1625188612", "security_groups": [{"name": "tempest-secgroup-smoke-1739001634"}], "block_device_mapping_v2": [{"uuid": "bcbf3130-fc4a-4880-bf51-e543c9c9a57e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9995752f-26c8-499b-851d-ac24052e53ae"}]}} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:19.776504 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.network.neutron [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] validate_networks() for [('9995752f-26c8-499b-851d-ac24052e53ae', None, None, None)] {{(pid=119154) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 28 04:17:20.134259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Flavor limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:17:20.134745 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Image limits 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:17:20.135239 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Flavor pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:17:20.135678 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Image pref 0:0:0 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:17:20.136156 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.virt.hardware [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119154) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:17:20.144554 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:20.145004 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:20.145825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:20.146259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:20.162426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Getting quotas for project 699932c5162645f89bbd9d95710d863b. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 28 04:17:20.166831 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.quota [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Getting quotas for user 21290886e90f45f582840b785d64cd43 and project 699932c5162645f89bbd9d95710d863b. Resources: {'ram', 'cores', 'instances'} {{(pid=119154) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 28 04:17:20.224654 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Going to run 1 instances... {{(pid=119154) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 28 04:17:20.226871 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bcbf3130-fc4a-4880-bf51-e543c9c9a57e',volume_size=None,volume_type=None)] {{(pid=119154) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 28 04:17:20.346458 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ba0db353-6697-4ae7-9159-d7ff85d874a9 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.677305 Jul 28 04:17:20.347082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1297/1701] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Jul 28 04:17:19 2021] POST /compute/v2.1/servers => generated 406 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:17:20.356703 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6c0ed4e9-4e41-4bd1-a7b7-54ecbea69f44 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:20.357309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6c0ed4e9-4e41-4bd1-a7b7-54ecbea69f44 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:20.409168 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6c0ed4e9-4e41-4bd1-a7b7-54ecbea69f44 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:20.415692 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6c0ed4e9-4e41-4bd1-a7b7-54ecbea69f44 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1095 microversion: 2.1 time: 0.062769 Jul 28 04:17:20.416272 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1298/1702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:20 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:21.432263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-65537360-f505-49d6-b911-3967e0979f07 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:21.433244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-65537360-f505-49d6-b911-3967e0979f07 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:21.439981 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65537360-f505-49d6-b911-3967e0979f07 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:21.440673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65537360-f505-49d6-b911-3967e0979f07 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:21.441790 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65537360-f505-49d6-b911-3967e0979f07 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:21.442382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-65537360-f505-49d6-b911-3967e0979f07 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:21.504948 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-65537360-f505-49d6-b911-3967e0979f07 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:21.512810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-65537360-f505-49d6-b911-3967e0979f07 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1211 microversion: 2.1 time: 0.084437 Jul 28 04:17:21.513366 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1299/1703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:21 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:22.530021 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-71e9874c-853e-4737-bb2c-a5bf4755c4c8 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:22.531324 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-71e9874c-853e-4737-bb2c-a5bf4755c4c8 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:22.537924 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71e9874c-853e-4737-bb2c-a5bf4755c4c8 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:22.538377 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71e9874c-853e-4737-bb2c-a5bf4755c4c8 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:22.539144 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71e9874c-853e-4737-bb2c-a5bf4755c4c8 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:22.539956 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-71e9874c-853e-4737-bb2c-a5bf4755c4c8 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:22.736941 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-71e9874c-853e-4737-bb2c-a5bf4755c4c8 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:22.746644 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-71e9874c-853e-4737-bb2c-a5bf4755c4c8 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1267 microversion: 2.1 time: 0.220695 Jul 28 04:17:22.747312 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1300/1704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:22 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:22.773617 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-51ff8fb2-3d89-4913-9085-a9e89e9adf3b req-d9bc20c7-9250-4d82-a6c1-70c71150747c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea683f0-d9be-4b20-8c81-25aa9ca6d992", "tag": "7d448be0-bb9e-40d8-99e6-8abf9ec9ee31"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:22.775172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:17:22.775172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:17:22.782724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-51ff8fb2-3d89-4913-9085-a9e89e9adf3b req-d9bc20c7-9250-4d82-a6c1-70c71150747c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:22.783339 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-51ff8fb2-3d89-4913-9085-a9e89e9adf3b req-d9bc20c7-9250-4d82-a6c1-70c71150747c service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:22.795635 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-51ff8fb2-3d89-4913-9085-a9e89e9adf3b req-d9bc20c7-9250-4d82-a6c1-70c71150747c service nova] Creating event network-changed:7d448be0-bb9e-40d8-99e6-8abf9ec9ee31 for instance 2ea683f0-d9be-4b20-8c81-25aa9ca6d992 on hv-cinder-73306 Jul 28 04:17:22.801215 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-51ff8fb2-3d89-4913-9085-a9e89e9adf3b req-d9bc20c7-9250-4d82-a6c1-70c71150747c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031180 Jul 28 04:17:22.802060 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1301/1705] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:17:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:17:23.764722 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-270392fa-7b59-4d71-a1cd-3c34e025879d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:23.765521 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-270392fa-7b59-4d71-a1cd-3c34e025879d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:23.771437 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-270392fa-7b59-4d71-a1cd-3c34e025879d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:23.772003 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-270392fa-7b59-4d71-a1cd-3c34e025879d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:23.772761 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-270392fa-7b59-4d71-a1cd-3c34e025879d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:23.773190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-270392fa-7b59-4d71-a1cd-3c34e025879d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:23.891326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-270392fa-7b59-4d71-a1cd-3c34e025879d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:23.898537 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-270392fa-7b59-4d71-a1cd-3c34e025879d tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1267 microversion: 2.1 time: 0.138525 Jul 28 04:17:23.899094 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1302/1706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:23 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:24.914878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-2c1e8b95-ff68-4fc7-82de-0e59d6d25583 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:24.915483 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-2c1e8b95-ff68-4fc7-82de-0e59d6d25583 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:24.921511 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c1e8b95-ff68-4fc7-82de-0e59d6d25583 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:24.921959 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c1e8b95-ff68-4fc7-82de-0e59d6d25583 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:24.922715 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c1e8b95-ff68-4fc7-82de-0e59d6d25583 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:24.923145 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-2c1e8b95-ff68-4fc7-82de-0e59d6d25583 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:25.045316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-2c1e8b95-ff68-4fc7-82de-0e59d6d25583 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:25.052482 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-2c1e8b95-ff68-4fc7-82de-0e59d6d25583 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1267 microversion: 2.1 time: 0.141234 Jul 28 04:17:25.053032 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1303/1707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:24 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:26.179347 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-08a160be-a789-4418-8422-9943bf700de7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:26.180022 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-08a160be-a789-4418-8422-9943bf700de7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:26.186316 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08a160be-a789-4418-8422-9943bf700de7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:26.186756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08a160be-a789-4418-8422-9943bf700de7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:26.187515 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08a160be-a789-4418-8422-9943bf700de7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:26.187978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-08a160be-a789-4418-8422-9943bf700de7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:26.306165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-08a160be-a789-4418-8422-9943bf700de7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:26.314149 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-08a160be-a789-4418-8422-9943bf700de7 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1267 microversion: 2.1 time: 0.248549 Jul 28 04:17:26.314705 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1304/1708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:26 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:27.330540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-04bcd61a-11c1-4e06-a092-f1e209e3a480 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:27.331182 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-04bcd61a-11c1-4e06-a092-f1e209e3a480 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:27.336939 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04bcd61a-11c1-4e06-a092-f1e209e3a480 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:27.337382 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04bcd61a-11c1-4e06-a092-f1e209e3a480 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:27.338131 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04bcd61a-11c1-4e06-a092-f1e209e3a480 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:27.338730 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-04bcd61a-11c1-4e06-a092-f1e209e3a480 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:27.456430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-04bcd61a-11c1-4e06-a092-f1e209e3a480 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:27.463604 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-04bcd61a-11c1-4e06-a092-f1e209e3a480 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1267 microversion: 2.1 time: 0.136557 Jul 28 04:17:27.464186 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1305/1709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:27 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:28.479739 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b7465ffd-4f62-4230-8ef7-9635df3d5973 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:28.480356 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b7465ffd-4f62-4230-8ef7-9635df3d5973 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:28.486346 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7465ffd-4f62-4230-8ef7-9635df3d5973 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:28.486794 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7465ffd-4f62-4230-8ef7-9635df3d5973 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:28.487553 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7465ffd-4f62-4230-8ef7-9635df3d5973 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:28.488020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b7465ffd-4f62-4230-8ef7-9635df3d5973 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:28.612845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-b7465ffd-4f62-4230-8ef7-9635df3d5973 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:28.620326 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b7465ffd-4f62-4230-8ef7-9635df3d5973 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1267 microversion: 2.1 time: 0.144113 Jul 28 04:17:28.620878 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1306/1710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:28 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:29.637637 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-8df3cafe-93cf-4d3d-bf37-6d23ff5c442e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:29.638244 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-8df3cafe-93cf-4d3d-bf37-6d23ff5c442e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:29.644001 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8df3cafe-93cf-4d3d-bf37-6d23ff5c442e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:29.644451 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8df3cafe-93cf-4d3d-bf37-6d23ff5c442e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:29.645206 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8df3cafe-93cf-4d3d-bf37-6d23ff5c442e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:29.645634 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-8df3cafe-93cf-4d3d-bf37-6d23ff5c442e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:29.765375 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-8df3cafe-93cf-4d3d-bf37-6d23ff5c442e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:29.772477 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-8df3cafe-93cf-4d3d-bf37-6d23ff5c442e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1267 microversion: 2.1 time: 0.139592 Jul 28 04:17:29.773027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1307/1711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:29 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:30.788509 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-26de528f-669d-4576-8317-be499d596949 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:30.789217 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-26de528f-669d-4576-8317-be499d596949 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:30.794723 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26de528f-669d-4576-8317-be499d596949 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:30.795172 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26de528f-669d-4576-8317-be499d596949 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:30.795961 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26de528f-669d-4576-8317-be499d596949 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:30.796397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26de528f-669d-4576-8317-be499d596949 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:30.916756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-26de528f-669d-4576-8317-be499d596949 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:30.924332 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-26de528f-669d-4576-8317-be499d596949 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1267 microversion: 2.1 time: 0.139389 Jul 28 04:17:30.924893 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1308/1712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:30 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:31.941606 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-dcf91222-8121-4eca-891b-e1d7e25ff67b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:31.942273 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-dcf91222-8121-4eca-891b-e1d7e25ff67b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:31.948123 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcf91222-8121-4eca-891b-e1d7e25ff67b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:31.948573 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcf91222-8121-4eca-891b-e1d7e25ff67b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:31.949340 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcf91222-8121-4eca-891b-e1d7e25ff67b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:31.949810 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-dcf91222-8121-4eca-891b-e1d7e25ff67b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:32.070253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-dcf91222-8121-4eca-891b-e1d7e25ff67b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:32.077873 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-dcf91222-8121-4eca-891b-e1d7e25ff67b tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1267 microversion: 2.1 time: 0.139973 Jul 28 04:17:32.078431 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1309/1713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:31 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:32.411259 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-b02d23e5-5cd9-447e-8c45-528760345454 req-a622009d-291e-44f2-8f7d-ad30bcef1298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea683f0-d9be-4b20-8c81-25aa9ca6d992", "name": "network-vif-plugged", "status": "completed", "tag": "7d448be0-bb9e-40d8-99e6-8abf9ec9ee31"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:32.412795 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:17:32.412795 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:17:32.419759 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-b02d23e5-5cd9-447e-8c45-528760345454 req-a622009d-291e-44f2-8f7d-ad30bcef1298 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:32.420302 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-b02d23e5-5cd9-447e-8c45-528760345454 req-a622009d-291e-44f2-8f7d-ad30bcef1298 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:32.431804 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-b02d23e5-5cd9-447e-8c45-528760345454 req-a622009d-291e-44f2-8f7d-ad30bcef1298 service nova] Creating event network-vif-plugged:7d448be0-bb9e-40d8-99e6-8abf9ec9ee31 for instance 2ea683f0-d9be-4b20-8c81-25aa9ca6d992 on hv-cinder-73306 Jul 28 04:17:32.437487 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-b02d23e5-5cd9-447e-8c45-528760345454 req-a622009d-291e-44f2-8f7d-ad30bcef1298 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029876 Jul 28 04:17:32.438252 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1310/1714] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:17:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:17:33.094522 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-ee0ed94c-d859-4c69-9ac5-aa1a06c68363 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:33.095219 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-ee0ed94c-d859-4c69-9ac5-aa1a06c68363 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:33.101242 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ee0ed94c-d859-4c69-9ac5-aa1a06c68363 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:33.101689 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ee0ed94c-d859-4c69-9ac5-aa1a06c68363 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:33.102444 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ee0ed94c-d859-4c69-9ac5-aa1a06c68363 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:33.102876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-ee0ed94c-d859-4c69-9ac5-aa1a06c68363 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:33.222128 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-ee0ed94c-d859-4c69-9ac5-aa1a06c68363 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:33.229257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-ee0ed94c-d859-4c69-9ac5-aa1a06c68363 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1267 microversion: 2.1 time: 0.138733 Jul 28 04:17:33.229933 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1311/1715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:33 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:34.245648 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-575e0b40-feb1-4ad9-b4e3-8ae58767d767 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:34.246253 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-575e0b40-feb1-4ad9-b4e3-8ae58767d767 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:34.252118 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-575e0b40-feb1-4ad9-b4e3-8ae58767d767 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:34.252571 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-575e0b40-feb1-4ad9-b4e3-8ae58767d767 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:34.253427 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-575e0b40-feb1-4ad9-b4e3-8ae58767d767 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:34.253867 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-575e0b40-feb1-4ad9-b4e3-8ae58767d767 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:34.375307 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-575e0b40-feb1-4ad9-b4e3-8ae58767d767 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:34.382502 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-575e0b40-feb1-4ad9-b4e3-8ae58767d767 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1454 microversion: 2.1 time: 0.141022 Jul 28 04:17:34.383105 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1312/1716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:34 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:34.397665 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eddaba17-9847-45ed-adb8-9a34db5d1348 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:34.398271 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eddaba17-9847-45ed-adb8-9a34db5d1348 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:17:34.403876 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eddaba17-9847-45ed-adb8-9a34db5d1348 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:34.404325 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eddaba17-9847-45ed-adb8-9a34db5d1348 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:34.405090 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eddaba17-9847-45ed-adb8-9a34db5d1348 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:34.405527 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eddaba17-9847-45ed-adb8-9a34db5d1348 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:34.522868 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eddaba17-9847-45ed-adb8-9a34db5d1348 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:34.530286 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eddaba17-9847-45ed-adb8-9a34db5d1348 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1454 microversion: 2.1 time: 0.135912 Jul 28 04:17:34.530880 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1313/1717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:17:34 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:36.334411 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-e8a06e20-94a6-4546-bec7-f73028f94fb6 req-b9058e9d-10d4-4f3d-9f6c-470ef8c9fbde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea683f0-d9be-4b20-8c81-25aa9ca6d992", "tag": "7d448be0-bb9e-40d8-99e6-8abf9ec9ee31"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:36.336113 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:17:36.336113 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:17:36.343289 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-e8a06e20-94a6-4546-bec7-f73028f94fb6 req-b9058e9d-10d4-4f3d-9f6c-470ef8c9fbde service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:17:36.343735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-e8a06e20-94a6-4546-bec7-f73028f94fb6 req-b9058e9d-10d4-4f3d-9f6c-470ef8c9fbde service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:17:36.355986 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-e8a06e20-94a6-4546-bec7-f73028f94fb6 req-b9058e9d-10d4-4f3d-9f6c-470ef8c9fbde service nova] Creating event network-changed:7d448be0-bb9e-40d8-99e6-8abf9ec9ee31 for instance 2ea683f0-d9be-4b20-8c81-25aa9ca6d992 on hv-cinder-73306 Jul 28 04:17:36.360940 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-e8a06e20-94a6-4546-bec7-f73028f94fb6 req-b9058e9d-10d4-4f3d-9f6c-470ef8c9fbde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031422 Jul 28 04:17:36.361541 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1314/1718] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:17:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:04.356306 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: ERROR oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 04:19:04.361052 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-b6c5e342-165c-40a0-9141-25d6799a9604 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:04.361640 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b6c5e342-165c-40a0-9141-25d6799a9604 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:04.367679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6c5e342-165c-40a0-9141-25d6799a9604 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:04.368169 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6c5e342-165c-40a0-9141-25d6799a9604 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:04.369095 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6c5e342-165c-40a0-9141-25d6799a9604 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:04.369676 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-b6c5e342-165c-40a0-9141-25d6799a9604 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:04.394585 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-b6c5e342-165c-40a0-9141-25d6799a9604 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 04:19:04.470441 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-b6c5e342-165c-40a0-9141-25d6799a9604 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 204 len: 0 microversion: 2.1 time: 0.115658 Jul 28 04:19:04.471418 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1315/1719] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:19:04 2021] DELETE /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:19:04.528249 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-a583f17c-bf3a-4be1-a54c-9dde0a9e6739 req-87df8515-6c6d-4fb9-86c4-4fa9f7dd66b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea683f0-d9be-4b20-8c81-25aa9ca6d992", "tag": "7d448be0-bb9e-40d8-99e6-8abf9ec9ee31"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:04.529712 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:19:04.529712 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:19:04.536328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-a583f17c-bf3a-4be1-a54c-9dde0a9e6739 req-87df8515-6c6d-4fb9-86c4-4fa9f7dd66b2 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:04.536775 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-a583f17c-bf3a-4be1-a54c-9dde0a9e6739 req-87df8515-6c6d-4fb9-86c4-4fa9f7dd66b2 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:04.547572 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-a583f17c-bf3a-4be1-a54c-9dde0a9e6739 req-87df8515-6c6d-4fb9-86c4-4fa9f7dd66b2 service nova] Creating event network-changed:7d448be0-bb9e-40d8-99e6-8abf9ec9ee31 for instance 2ea683f0-d9be-4b20-8c81-25aa9ca6d992 on hv-cinder-73306 Jul 28 04:19:04.552328 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-a583f17c-bf3a-4be1-a54c-9dde0a9e6739 req-87df8515-6c6d-4fb9-86c4-4fa9f7dd66b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079298 Jul 28 04:19:04.553087 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1316/1720] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:19:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:04.558055 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-cf5131dd-4670-44c0-b1e5-5f8b2778efa1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:04.558747 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-cf5131dd-4670-44c0-b1e5-5f8b2778efa1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:04.564539 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf5131dd-4670-44c0-b1e5-5f8b2778efa1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:04.564988 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf5131dd-4670-44c0-b1e5-5f8b2778efa1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:04.565752 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf5131dd-4670-44c0-b1e5-5f8b2778efa1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:04.566188 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-cf5131dd-4670-44c0-b1e5-5f8b2778efa1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:04.864221 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-cf5131dd-4670-44c0-b1e5-5f8b2778efa1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:04.871677 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-cf5131dd-4670-44c0-b1e5-5f8b2778efa1 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1578 microversion: 2.1 time: 0.317602 Jul 28 04:19:04.872608 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1317/1721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:19:04 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1578 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:05.888943 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-6ad734fa-c44c-4f4a-90f0-3fe1c7f24ecd tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:05.889604 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-6ad734fa-c44c-4f4a-90f0-3fe1c7f24ecd tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:05.906786 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ad734fa-c44c-4f4a-90f0-3fe1c7f24ecd tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:05.907241 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ad734fa-c44c-4f4a-90f0-3fe1c7f24ecd tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:05.908037 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ad734fa-c44c-4f4a-90f0-3fe1c7f24ecd tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:05.908512 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-6ad734fa-c44c-4f4a-90f0-3fe1c7f24ecd tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:05.926909 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] [81d59a9c-a64a-4905-9be9-3bafed6c3005] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48052. Jul 28 04:19:06.029928 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-6ad734fa-c44c-4f4a-90f0-3fe1c7f24ecd tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:06.037067 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-6ad734fa-c44c-4f4a-90f0-3fe1c7f24ecd tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1460 microversion: 2.1 time: 0.152436 Jul 28 04:19:06.037620 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1318/1722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:19:05 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1460 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:06.708364 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-ff413a92-32dd-456d-b9cd-e69db52cdf50 req-a8536b0d-d75c-46f0-a634-51c84dc75826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea683f0-d9be-4b20-8c81-25aa9ca6d992", "name": "network-vif-deleted", "tag": "7d448be0-bb9e-40d8-99e6-8abf9ec9ee31"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:06.709886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:19:06.709886 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:19:06.717223 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-ff413a92-32dd-456d-b9cd-e69db52cdf50 req-a8536b0d-d75c-46f0-a634-51c84dc75826 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:06.717659 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-ff413a92-32dd-456d-b9cd-e69db52cdf50 req-a8536b0d-d75c-46f0-a634-51c84dc75826 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:06.728096 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-ff413a92-32dd-456d-b9cd-e69db52cdf50 req-a8536b0d-d75c-46f0-a634-51c84dc75826 service nova] Creating event network-vif-deleted:7d448be0-bb9e-40d8-99e6-8abf9ec9ee31 for instance 2ea683f0-d9be-4b20-8c81-25aa9ca6d992 on hv-cinder-73306 Jul 28 04:19:06.734291 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-ff413a92-32dd-456d-b9cd-e69db52cdf50 req-a8536b0d-d75c-46f0-a634-51c84dc75826 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029487 Jul 28 04:19:06.735159 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1319/1723] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:19:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:19:07.055462 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-50706c02-fc54-4809-8b8d-3e474fd64136 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:07.056292 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-50706c02-fc54-4809-8b8d-3e474fd64136 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:07.063260 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50706c02-fc54-4809-8b8d-3e474fd64136 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:07.063788 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50706c02-fc54-4809-8b8d-3e474fd64136 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:07.064579 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50706c02-fc54-4809-8b8d-3e474fd64136 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:07.068756 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-50706c02-fc54-4809-8b8d-3e474fd64136 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:07.141195 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-50706c02-fc54-4809-8b8d-3e474fd64136 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:07.148907 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-50706c02-fc54-4809-8b8d-3e474fd64136 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 200 len: 1226 microversion: 2.1 time: 0.097466 Jul 28 04:19:07.149412 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1320/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:19:07 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:08.165834 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4eec0b1d-4df0-40fc-9910-2b4844ba743e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:08.166607 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4eec0b1d-4df0-40fc-9910-2b4844ba743e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 2ea683f0-d9be-4b20-8c81-25aa9ca6d992] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:08.172526 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eec0b1d-4df0-40fc-9910-2b4844ba743e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:08.172972 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eec0b1d-4df0-40fc-9910-2b4844ba743e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:08.173736 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eec0b1d-4df0-40fc-9910-2b4844ba743e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:08.174174 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4eec0b1d-4df0-40fc-9910-2b4844ba743e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:08.188387 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-4eec0b1d-4df0-40fc-9910-2b4844ba743e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] HTTP exception thrown: Instance 2ea683f0-d9be-4b20-8c81-25aa9ca6d992 could not be found. Jul 28 04:19:08.188965 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4eec0b1d-4df0-40fc-9910-2b4844ba743e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Returning 404 to user: Instance 2ea683f0-d9be-4b20-8c81-25aa9ca6d992 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:19:08.189768 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4eec0b1d-4df0-40fc-9910-2b4844ba743e tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992" status: 404 len: 111 microversion: 2.1 time: 0.027698 Jul 28 04:19:08.190283 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1321/1725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:19:08 2021] GET /compute/v2.1/servers/2ea683f0-d9be-4b20-8c81-25aa9ca6d992 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:19:11.225680 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-c5ae8ed8-b583-492a-ad32-61d429a84896 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:11.226255 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c5ae8ed8-b583-492a-ad32-61d429a84896 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:11.232269 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ed8-b583-492a-ad32-61d429a84896 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:11.232825 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ed8-b583-492a-ad32-61d429a84896 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:11.233662 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ed8-b583-492a-ad32-61d429a84896 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:11.234263 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-c5ae8ed8-b583-492a-ad32-61d429a84896 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:11.258631 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-c5ae8ed8-b583-492a-ad32-61d429a84896 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Going to try to terminate instance {{(pid=119154) delete /opt/stack/nova/nova/compute/api.py:2540}} Jul 28 04:19:11.337397 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-c5ae8ed8-b583-492a-ad32-61d429a84896 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 204 len: 0 microversion: 2.1 time: 0.115139 Jul 28 04:19:11.338934 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1322/1726] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:19:11 2021] DELETE /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:19:11.345416 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-226cf52a-8b9a-42d6-b15c-4bfd6e0de3ba req-38726e97-4720-4213-b42f-b432cf39cfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb64262-ada3-4a82-b9cf-2c15cb9bd809", "tag": "a40c7d93-c9e2-45ad-aa9d-d3ac36535c30"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:11.346868 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:19:11.346868 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:19:11.353660 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-226cf52a-8b9a-42d6-b15c-4bfd6e0de3ba req-38726e97-4720-4213-b42f-b432cf39cfb2 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:11.354313 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-226cf52a-8b9a-42d6-b15c-4bfd6e0de3ba req-38726e97-4720-4213-b42f-b432cf39cfb2 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:11.365109 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-226cf52a-8b9a-42d6-b15c-4bfd6e0de3ba req-38726e97-4720-4213-b42f-b432cf39cfb2 service nova] Creating event network-changed:a40c7d93-c9e2-45ad-aa9d-d3ac36535c30 for instance 0eb64262-ada3-4a82-b9cf-2c15cb9bd809 on hv-cinder-73306 Jul 28 04:19:11.370165 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-226cf52a-8b9a-42d6-b15c-4bfd6e0de3ba req-38726e97-4720-4213-b42f-b432cf39cfb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029655 Jul 28 04:19:11.370735 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1323/1727] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:11.375330 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-d3c1fb9c-4eab-43d4-aadd-6e16182990f0 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:11.376042 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-d3c1fb9c-4eab-43d4-aadd-6e16182990f0 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:11.381784 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d3c1fb9c-4eab-43d4-aadd-6e16182990f0 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:11.382225 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d3c1fb9c-4eab-43d4-aadd-6e16182990f0 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:11.382974 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d3c1fb9c-4eab-43d4-aadd-6e16182990f0 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:11.383401 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-d3c1fb9c-4eab-43d4-aadd-6e16182990f0 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:11.582921 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-d3c1fb9c-4eab-43d4-aadd-6e16182990f0 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:11.592065 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-d3c1fb9c-4eab-43d4-aadd-6e16182990f0 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1576 microversion: 2.1 time: 0.220172 Jul 28 04:19:11.592900 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1324/1728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:19:11 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:12.609309 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-eda33962-6935-4876-baaf-01b166c92ed6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:12.610190 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-eda33962-6935-4876-baaf-01b166c92ed6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:12.616187 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eda33962-6935-4876-baaf-01b166c92ed6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:12.616639 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eda33962-6935-4876-baaf-01b166c92ed6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:12.617409 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eda33962-6935-4876-baaf-01b166c92ed6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:12.617841 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-eda33962-6935-4876-baaf-01b166c92ed6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:12.739082 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-eda33962-6935-4876-baaf-01b166c92ed6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:12.747110 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-eda33962-6935-4876-baaf-01b166c92ed6 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1458 microversion: 2.1 time: 0.141437 Jul 28 04:19:12.747679 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1325/1729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:19:12 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1458 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:13.518362 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [req-b95b8900-6397-449f-a363-41b4241e90b1 req-3560f6b8-a47c-4feb-8fea-ca6cc2e24f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb64262-ada3-4a82-b9cf-2c15cb9bd809", "name": "network-vif-deleted", "tag": "a40c7d93-c9e2-45ad-aa9d-d3ac36535c30"}]} {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:13.520007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:19:13.520007 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: warnings.warn(msg) Jul 28 04:19:13.527643 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-b95b8900-6397-449f-a363-41b4241e90b1 req-3560f6b8-a47c-4feb-8fea-ca6cc2e24f26 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:13.528191 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [req-b95b8900-6397-449f-a363-41b4241e90b1 req-3560f6b8-a47c-4feb-8fea-ca6cc2e24f26 service nova] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:13.539013 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.compute.server_external_events [req-b95b8900-6397-449f-a363-41b4241e90b1 req-3560f6b8-a47c-4feb-8fea-ca6cc2e24f26 service nova] Creating event network-vif-deleted:a40c7d93-c9e2-45ad-aa9d-d3ac36535c30 for instance 0eb64262-ada3-4a82-b9cf-2c15cb9bd809 on hv-cinder-73306 Jul 28 04:19:13.543844 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [req-b95b8900-6397-449f-a363-41b4241e90b1 req-3560f6b8-a47c-4feb-8fea-ca6cc2e24f26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029031 Jul 28 04:19:13.544473 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1326/1730] 10.222.0.16 () {64 vars in 1318 bytes} [Wed Jul 28 04:19:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:19:13.765023 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-4ee07f63-f362-4c07-91b1-05c3deee9adb tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:13.765666 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-4ee07f63-f362-4c07-91b1-05c3deee9adb tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:13.771563 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ee07f63-f362-4c07-91b1-05c3deee9adb tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:13.772047 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ee07f63-f362-4c07-91b1-05c3deee9adb tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:13.772858 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ee07f63-f362-4c07-91b1-05c3deee9adb tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:13.773299 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-4ee07f63-f362-4c07-91b1-05c3deee9adb tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:13.839371 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.policy [None req-4ee07f63-f362-4c07-91b1-05c3deee9adb tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21290886e90f45f582840b785d64cd43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '699932c5162645f89bbd9d95710d863b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119154) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:13.847288 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-4ee07f63-f362-4c07-91b1-05c3deee9adb tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 200 len: 1225 microversion: 2.1 time: 0.086306 Jul 28 04:19:13.857113 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1327/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:19:13 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:14.864354 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-79a7785a-0119-4b83-ae48-41829b10a947 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:14.865014 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-79a7785a-0119-4b83-ae48-41829b10a947 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 0eb64262-ada3-4a82-b9cf-2c15cb9bd809] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:14.870807 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79a7785a-0119-4b83-ae48-41829b10a947 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:14.871248 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79a7785a-0119-4b83-ae48-41829b10a947 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:14.872020 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79a7785a-0119-4b83-ae48-41829b10a947 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:14.872455 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-79a7785a-0119-4b83-ae48-41829b10a947 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:14.885703 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-79a7785a-0119-4b83-ae48-41829b10a947 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] HTTP exception thrown: Instance 0eb64262-ada3-4a82-b9cf-2c15cb9bd809 could not be found. Jul 28 04:19:14.886272 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-79a7785a-0119-4b83-ae48-41829b10a947 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Returning 404 to user: Instance 0eb64262-ada3-4a82-b9cf-2c15cb9bd809 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:19:14.887059 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-79a7785a-0119-4b83-ae48-41829b10a947 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809" status: 404 len: 111 microversion: 2.1 time: 0.026358 Jul 28 04:19:14.887560 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1328/1732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:19:14 2021] GET /compute/v2.1/servers/0eb64262-ada3-4a82-b9cf-2c15cb9bd809 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:19:15.330540 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-26f59a31-47ba-40af-8820-0b1b89d26707 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:15.331050 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-26f59a31-47ba-40af-8820-0b1b89d26707 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:15.336845 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26f59a31-47ba-40af-8820-0b1b89d26707 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:15.337298 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26f59a31-47ba-40af-8820-0b1b89d26707 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:15.338167 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26f59a31-47ba-40af-8820-0b1b89d26707 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:15.338602 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-26f59a31-47ba-40af-8820-0b1b89d26707 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:15.351426 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-26f59a31-47ba-40af-8820-0b1b89d26707 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] HTTP exception thrown: Instance 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 could not be found. Jul 28 04:19:15.352027 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-26f59a31-47ba-40af-8820-0b1b89d26707 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Returning 404 to user: Instance 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:19:15.352830 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-26f59a31-47ba-40af-8820-0b1b89d26707 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 404 len: 111 microversion: 2.1 time: 0.026078 Jul 28 04:19:15.353549 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1329/1733] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Jul 28 04:19:15 2021] DELETE /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:19:15.361125 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-57a70059-b49f-47b4-8e38-bb0afc175e3f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:15.361724 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.compute.api [None req-57a70059-b49f-47b4-8e38-bb0afc175e3f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] [instance: 3e3a4679-ad02-41d6-9d56-5e56a98e9d88] Fetching instance by UUID {{(pid=119154) get /opt/stack/nova/nova/compute/api.py:2791}} Jul 28 04:19:15.366978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57a70059-b49f-47b4-8e38-bb0afc175e3f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:15.367430 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57a70059-b49f-47b4-8e38-bb0afc175e3f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:15.368229 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57a70059-b49f-47b4-8e38-bb0afc175e3f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 28 04:19:15.368669 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG oslo_concurrency.lockutils [None req-57a70059-b49f-47b4-8e38-bb0afc175e3f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Lock "c9a031e6-2f7b-43a5-9c59-929dc71d7c62" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 28 04:19:15.381673 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.wsgi [None req-57a70059-b49f-47b4-8e38-bb0afc175e3f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] HTTP exception thrown: Instance 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 could not be found. Jul 28 04:19:15.382185 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-57a70059-b49f-47b4-8e38-bb0afc175e3f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Returning 404 to user: Instance 3e3a4679-ad02-41d6-9d56-5e56a98e9d88 could not be found. {{(pid=119154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 28 04:19:15.382978 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-57a70059-b49f-47b4-8e38-bb0afc175e3f tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88" status: 404 len: 111 microversion: 2.1 time: 0.025342 Jul 28 04:19:15.383476 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1330/1734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Jul 28 04:19:15 2021] GET /compute/v2.1/servers/3e3a4679-ad02-41d6-9d56-5e56a98e9d88 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:19:16.664930 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: DEBUG nova.api.openstack.wsgi [None req-df458aaf-ea7f-4002-bb1e-6b0f2d8569e5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] Calling method '.version_select at 0x7f6806adea60>' {{(pid=119154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:16.684776 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO nova.api.openstack.requestlog [None req-df458aaf-ea7f-4002-bb1e-6b0f2d8569e5 tempest-TestVolumeBootPattern-1395457775 tempest-TestVolumeBootPattern-1395457775-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1625188612" status: 202 len: 0 microversion: 2.1 time: 0.023549 Jul 28 04:19:16.685342 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: [pid: 119154|app: 0|req: 1331/1735] 10.222.0.16 () {58 vars in 1263 bytes} [Wed Jul 28 04:19:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1625188612 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:20:35.133201 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:20:35.133782 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:20:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:22:27.535774 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:22:27.536428 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:22:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:22:30.950257 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:22:30.950889 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:22:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:23:55.153115 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:23:55.153645 dv-cinder-733062-21-iscsi devstack@n-api.service[119154]: Wed Jul 28 04:23:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!